-- Logs begin at Mon 2022-10-31 14:14:46 UTC, end at Mon 2022-10-31 15:30:53 UTC. -- Oct 31 14:46:24.293798 dv-cinder-860227-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 14:46:24 2022] *** Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: nodename: dv-cinder-860227-3-smb Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: machine: x86_64 Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: clock source: unix Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: pcre jit disabled Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: detected number of CPU cores: 4 Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: current working directory: / Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: detected binary path: /usr/bin/uwsgi-core Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: your processes number limit is 47680 Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: your memory page size is 4096 bytes Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: detected max file descriptor number: 2048 Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: lock engine: pthread robust mutexes Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: thunder lock: enabled Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 31 14:46:24.305380 dv-cinder-860227-3-smb devstack@keystone.service[81670]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 14:46:24.345309 dv-cinder-860227-3-smb devstack@keystone.service[81670]: Python main interpreter initialized at 0x55fd6be939c0 Oct 31 14:46:24.345309 dv-cinder-860227-3-smb devstack@keystone.service[81670]: python threads support enabled Oct 31 14:46:24.345309 dv-cinder-860227-3-smb devstack@keystone.service[81670]: your server socket listen backlog is limited to 100 connections Oct 31 14:46:24.345309 dv-cinder-860227-3-smb devstack@keystone.service[81670]: your mercy for graceful operations on workers is 90 seconds Oct 31 14:46:24.345645 dv-cinder-860227-3-smb devstack@keystone.service[81670]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 14:46:24.345720 dv-cinder-860227-3-smb devstack@keystone.service[81670]: *** Operational MODE: preforking *** Oct 31 14:46:24.346001 dv-cinder-860227-3-smb devstack@keystone.service[81670]: *** uWSGI is running in multiple interpreter mode *** Oct 31 14:46:24.346001 dv-cinder-860227-3-smb devstack@keystone.service[81670]: spawned uWSGI master process (pid: 81670) Oct 31 14:46:24.346201 dv-cinder-860227-3-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 31 14:46:24.347262 dv-cinder-860227-3-smb devstack@keystone.service[81670]: spawned uWSGI worker 1 (pid: 81683, cores: 1) Oct 31 14:46:24.347262 dv-cinder-860227-3-smb devstack@keystone.service[81670]: spawned uWSGI worker 2 (pid: 81684, cores: 1) Oct 31 14:46:24.347262 dv-cinder-860227-3-smb devstack@keystone.service[81670]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 14:46:28.734932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:46:28.734932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: from cryptography.utils import int_from_bytes Oct 31 14:46:28.735745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:46:28.735745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: from cryptography.utils import int_from_bytes Oct 31 14:46:28.736460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:46:28.736460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: from cryptography.utils import int_from_bytes Oct 31 14:46:28.736909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 14:46:28.736909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: from cryptography.utils import int_from_bytes Oct 31 14:46:28.786780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 14:46:28.786956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 14:46:28.787150 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] command line args: [] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 14:46:28.787434 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 14:46:28.787598 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ================================================================================ {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 14:46:28.787853 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] admin_token = **** {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.788099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] config_dir = [] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.788288 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.788471 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] config_source = [] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.788654 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] debug = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.788855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.789177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 14:46:28.789263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.789402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 14:46:28.789477 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.789577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] command line args: [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 14:46:28.789656 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.789847 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 14:46:28.789958 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.790058 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ================================================================================ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 14:46:28.790175 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] list_limit = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.790269 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] admin_token = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.790372 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] log_config_append = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.790466 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.790563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] config_dir = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.790655 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] log_dir = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.790751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.790851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] log_file = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.790955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] config_source = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.791061 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.791203 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] debug = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.791287 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.791406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.791510 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.791588 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.791709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.791883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.792050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.792131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.792245 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.792386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.792464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.792628 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.792742 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.792860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_config_append = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.792979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.793089 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.793205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.793352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_dir = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.793515 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_file = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.793723 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.793842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.793943 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.794062 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.794173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.794283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.794394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.794505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.794617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.794724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.794724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.794944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.795067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.795187 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] publish_errors = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.795299 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.795422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.795539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.795656 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.795772 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.795882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.795997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.796159 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.796273 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.796382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.796498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.796608 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] standard_threads = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.796608 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.796833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.796944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.797054 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.797165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.797165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] use_journal = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.797428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] use_json = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.797539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.797657 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] use_stderr = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.797767 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] publish_errors = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.797894 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] use_syslog = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.798006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.798122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.798240 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.798351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.798460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.798577 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.798695 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.798796 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.798910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.799021 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.799131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] standard_threads = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.799317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.799436 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.799548 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.799655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.799655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.799834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.799936 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_journal = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.800030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.800129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_json = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.800129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_stderr = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.800308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.800401 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_syslog = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.800501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.800601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 14:46:28.800695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.800793 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.800885 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.800977 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.801075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.801169 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.801321 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.801422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.801514 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.806116 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.806237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.806317 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.806385 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.806460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.806530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.806610 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.806680 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.806796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.806918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.807042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.807125 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.807251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.807332 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.807445 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.807560 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.807633 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.807702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.807778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.807848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.807916 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.807983 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.808051 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.808118 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.808258 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.808329 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.808403 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.808472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.808540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.808614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.808691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.808760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.808827 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.808894 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.808894 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809015 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809090 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809798 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809798 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809930 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.809999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.810066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.810138 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.810213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.810289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.810371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.810450 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.810519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.810585 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.810682 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.810761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.810841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.810911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.810979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.811052 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.811158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.811261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.811395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.811501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.811602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.811696 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.811789 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.811891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.811994 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.812095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.812181 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.812252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.812310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.812376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.812490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.812572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.812642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.812761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.812836 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.812913 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.812984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.813108 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.813205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.813280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.813399 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.813514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.813586 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.813712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.813855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.813933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.814047 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.814129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.814207 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.814285 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.814361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.814483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.814556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.814625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.814738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.814824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.814895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.815009 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.815089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.815160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.815272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.815376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.815452 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.815559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.815634 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.815709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.815779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.815851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.815921 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.815986 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.816061 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.816137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.816203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.816346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.816417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.816485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.816548 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.816616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.816683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.816754 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.816830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.816906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.816975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.817050 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.817120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.817200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.817295 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.817369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.817437 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.817501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.817579 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.817679 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.817767 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.817918 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.817997 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.818169 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.818247 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.818412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.818496 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.818655 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.818731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.818894 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.818969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.819129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.819217 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.819365 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.819440 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.819603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.819678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.819838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.819925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.820065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.820142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.820296 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.820371 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.820526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.820610 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.820760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.820836 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.820990 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.821066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.821230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.821337 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.821489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.821569 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.821726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.821801 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.821962 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.822049 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.822197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.822273 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.822991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.823078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.823263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.823374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.823538 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] auth.external = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.823614 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.823823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.823907 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.824071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.824167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.824311 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.824400 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.824543 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.824620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] auth.password = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.824781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] auth.token = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.824888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.825018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.825104 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.825250 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.825348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.825521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.825601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.825753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.825839 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.826003 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.826088 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.826246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.826323 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.826475 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.826560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.external = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.826706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.826790 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] credential.caching = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.826950 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.827031 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.827199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.827306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.827446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.password = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.827523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.827682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.token = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.827760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.828142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.828242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.828242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.828372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.828471 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.828549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.828701 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.828786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.828948 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.829025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.829194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.829270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.829457 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.829537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.829699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.829776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.829951 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.830030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.830203 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.830290 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.830456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.830533 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.830692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] federation.caching = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.830769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.830930 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.831009 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.831166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.831242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.831409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.831524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.831638 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.831719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.831885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.831971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.832119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.832203 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.832373 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.832453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.832612 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.832697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.832867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.832945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.833107 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.833187 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.833384 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.833506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.833623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.caching = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.833714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.833871 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.833951 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.834114 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.834191 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.834350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.834427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.834580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.834659 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.834823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.834900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.835055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.835132 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.835294 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.835373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.835530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.835613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.835781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.835896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.836038 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.836142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.836264 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.836368 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.836494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.836598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.836745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.836876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.836977 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.837071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.837208 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.837328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.846327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.846475 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.846475 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.846658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.846658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.846804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.846883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.846955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.847024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.847093 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.847093 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.847274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.847349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.847419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.847488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.847557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.847673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.847755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.847827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.847897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.847966 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848034 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848103 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848256 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848325 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848463 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848532 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848747 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.848951 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849236 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849576 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849784 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849784 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849915 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.849986 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.850055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.850123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.850192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.850192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.850393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.850466 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.850536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.850612 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.850682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.850751 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.850839 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.850917 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.850988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851281 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.851969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.852092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.852169 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.852240 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.852309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.852378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.852454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.852525 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.852602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.852672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.852741 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.852809 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.852878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.852946 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853023 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853159 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853451 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853523 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853593 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853828 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853906 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.853977 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854191 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854255 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854331 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854470 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854538 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854752 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.854961 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.855029 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.855097 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.855174 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.855245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.855314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.855382 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.855450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.855528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.855599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.855667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.855736 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.855804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.855873 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856333 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856480 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856687 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] resource.caching = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856902 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.856971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857039 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857107 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857169 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857244 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857481 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857560 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857620 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.857962 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858030 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] role.caching = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] role.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858523 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858523 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.858997 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.859066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.859135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.859203 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.859272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.859348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.859419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.859488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.859629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.859743 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.859860 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.859986 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.860107 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.860235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.860353 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.860477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.860598 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.860720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.860844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.860958 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] role.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.861208 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] role.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.861302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.861479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.861570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.861732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.861841 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.861978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.862067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.862222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.862307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.862468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.862546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.862702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.862780 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.862950 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.863027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.863198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.863275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.863439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.863516 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.863670 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.863748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.863897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.863974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.864127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.864204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.864377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.864487 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.864711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.864829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.864946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.865183 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.865369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.865488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.865601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.865713 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.865939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] token.caching = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.866059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.866173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.866285 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.866397 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.866508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.866620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.866740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.866854 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.866966 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.867077 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.867187 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.867299 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.867420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.867534 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.867646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.867758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.867869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.867980 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.868101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.868214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.868326 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.868438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.868550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.868661 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.868780 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.868894 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.869006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.869117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.869228 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.869879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.870059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.870190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.870334 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.870451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.870594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.connection = **** {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.870712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.870825 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.870947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.871062 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.871167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.871341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.871457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.871571 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.871691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.871840 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.871956 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.872068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.872180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.872292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.872413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.872527 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.872635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.872775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.872914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.873030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.873152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.873265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.873435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.873547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.873660 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.873772 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.873896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.874011 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.874122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.874243 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.874365 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.874479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.874591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.874712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.874826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.874938 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.875053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81684) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 14:46:28.875166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.875331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.875574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.875821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.876061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.876301 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.876541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.876806 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.877055 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.877307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.877565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.877805 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.878055 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.878295 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.878567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.878801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.879049 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.879344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 14:46:28.879564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 14:46:28.905453 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:28.905678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:28.905902 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:28.914409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:28.915013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:28.915246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:28.915470 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:28.924728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:28.944293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:28.944603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:28.945338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:28.945570 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:28.998991 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.004103 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.047897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.048129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.049865 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.050108 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.203368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.203555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.203663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.203762 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.203840 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.203912 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.203984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.204129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.204221 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.204352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.204433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.204578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.228169 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.228367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.228467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.228618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.228701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.228895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.229004 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.229162 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.229366 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.229443 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.229515 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.229587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.229677 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.229899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.240656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.240754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.253740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.253921 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.254143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.254360 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.254572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.254651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.254781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.254870 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.254996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81684) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.255072 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.255266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.255488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.255705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.255920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 31 14:46:29.272448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.272659 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 14:46:29.272741 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.272922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 14:46:29.273004 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.273189 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 14:46:29.273269 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.273495 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 31 14:46:29.273574 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.273755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.273835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.274025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.274264 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.274344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.274526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.274613 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.284351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.284565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.284646 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.284844 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.284937 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.285119 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.285199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.285429 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.292890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.293200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.295796 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.296083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.296162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.296363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.296443 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.296644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.296725 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.296928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.297008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.297190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.297278 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.297484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.297564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.297756 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.297836 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.298027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.298138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.298300 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.298414 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.298575 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.298684 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.298845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.321204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.322028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.323235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.323521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.324277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.324567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.329097 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.329410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.329702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.329866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.330152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.330433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.336155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.336447 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.337065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.337387 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.340553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.340847 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.341135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.341447 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.341618 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.341727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.341908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.342192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.342475 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.342752 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.343039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.343312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.343597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.343675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.343974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.344275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.359851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.360131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.360277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.360579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.363994 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.364403 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.367229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.367508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.367591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.367807 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.371803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.372379 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.374945 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.375489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.378178 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.378480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.378657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.378784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.378960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.379099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.379248 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.379374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.379541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.379674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.379826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.380213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.395827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.396117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.396380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.396641 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.396887 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.397182 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.397481 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.397753 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.403813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.404878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.405372 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.406567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.406918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.407195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.408138 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.408420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.409898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.410187 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.410580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.410870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.411088 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.411213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.411376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.411661 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.411947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.412239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.422853 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.423148 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.423524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.423808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.424102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.424226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.424388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.424512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.424663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.424794 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.424932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.425230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.425548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.425826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.440149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.441276 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.443115 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.444352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.446001 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.447305 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.447960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.449472 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.449669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.449964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.450246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.450960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.451252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.451544 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.456552 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.458022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.458151 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.459516 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.461095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.461418 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.461704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.461981 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.462425 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.462718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.463008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.463374 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.469932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.470226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.470524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.471520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.471815 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.472101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.478263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81684) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.478550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.479459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.479742 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.479876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 31 14:46:29.480023 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.480148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.480298 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.480427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.480553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.480690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.480819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.480947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.481073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.481199 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.481354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.481480 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.481603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.481744 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.481939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.482162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.482284 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.482412 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.482535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81684) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.482657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.482779 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.483044 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.483315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 31 14:46:29.515958 dv-cinder-860227-3-smb devstack@keystone.service[81684]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fd6be939c0 pid: 81684 (default app) Oct 31 14:46:29.517960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fd6be939c0 pid: 81683 (default app) Oct 31 14:46:29.519181 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0fedb-6c21-4d2b-ad71-2a7fd008b4ce None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:29.519465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0fedb-6c21-4d2b-ad71-2a7fd008b4ce None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:29.519733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0fedb-6c21-4d2b-ad71-2a7fd008b4ce None None] PATH_INFO: `/v3` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:29.523867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Mon Oct 31 14:46:29 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:37.684541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a35d9-d027-4394-bde2-c10eac3ca1ab None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:37.685137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a35d9-d027-4394-bde2-c10eac3ca1ab None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:37.685137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a35d9-d027-4394-bde2-c10eac3ca1ab None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:37.689382 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:46:37.694762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb71ee-60a1-48bb-bff0-027da7a781c1 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:37.695291 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb71ee-60a1-48bb-bff0-027da7a781c1 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:37.695291 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb71ee-60a1-48bb-bff0-027da7a781c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:37.765720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: INFO dbcounter [None req-9aeb71ee-60a1-48bb-bff0-027da7a781c1 None None] Registered counter for database keystone Oct 31 14:46:37.787391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG oslo_db.sqlalchemy.engines [None req-9aeb71ee-60a1-48bb-bff0-027da7a781c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81684) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:46:37.793750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writer thread running {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:46:37.975217 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG passlib.handlers.bcrypt [None req-9aeb71ee-60a1-48bb-bff0-027da7a781c1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81684) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 31 14:46:37.975520 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG passlib.handlers.bcrypt [None req-9aeb71ee-60a1-48bb-bff0-027da7a781c1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81684) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 31 14:46:38.034467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-9aeb71ee-60a1-48bb-bff0-027da7a781c1 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:38.036052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9aeb71ee-60a1-48bb-bff0-027da7a781c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:38.163062 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 31 14:46:38.654389 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a35d9-d027-4394-bde2-c10eac3ca1ab None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:38.723729 dv-cinder-860227-3-smb devstack@keystone.service[81683]: INFO dbcounter [None req-609a35d9-d027-4394-bde2-c10eac3ca1ab None None] Registered counter for database keystone Oct 31 14:46:38.743341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG oslo_db.sqlalchemy.engines [None req-609a35d9-d027-4394-bde2-c10eac3ca1ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 14:46:38.749558 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writer thread running {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 14:46:38.866139 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a35d9-d027-4394-bde2-c10eac3ca1ab None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:38.870947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f1622-ed16-4dad-9f12-e59741ce2966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:38.871559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f1622-ed16-4dad-9f12-e59741ce2966 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:38.871835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f1622-ed16-4dad-9f12-e59741ce2966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:38.872103 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f1622-ed16-4dad-9f12-e59741ce2966 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:38.880193 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f1622-ed16-4dad-9f12-e59741ce2966 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:38.932762 dv-cinder-860227-3-smb devstack@keystone.service[81683]: WARNING keystone.common.rbac_enforcer.enforcer [None req-921f1622-ed16-4dad-9f12-e59741ce2966 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 31 14:46:38.933093 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f1622-ed16-4dad-9f12-e59741ce2966 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:38.942578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Mon Oct 31 14:46:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 14:46:38.948809 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb71ee-60a1-48bb-bff0-027da7a781c1 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:38.965817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb71ee-60a1-48bb-bff0-027da7a781c1 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:38.970239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05b2b6-baee-42aa-b1bc-d153edf663f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:38.971351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05b2b6-baee-42aa-b1bc-d153edf663f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:38.971627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05b2b6-baee-42aa-b1bc-d153edf663f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:38.971896 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05b2b6-baee-42aa-b1bc-d153edf663f6 admin admin] PATH_INFO: `/v3/projects/e4bc3597085f4d879b8fe33c50ed5ee8` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:38.975763 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05b2b6-baee-42aa-b1bc-d153edf663f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=e4bc3597085f4d879b8fe33c50ed5ee8)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:39.027481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5c05b2b6-baee-42aa-b1bc-d153edf663f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 31 14:46:39.027825 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05b2b6-baee-42aa-b1bc-d153edf663f6 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:39.032544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Mon Oct 31 14:46:38 2022] GET /identity/v3/projects/e4bc3597085f4d879b8fe33c50ed5ee8 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:41.248538 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebdcfb-17b3-4073-9096-4aa0e43ea837 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:41.249039 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebdcfb-17b3-4073-9096-4aa0e43ea837 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:41.249039 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebdcfb-17b3-4073-9096-4aa0e43ea837 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:41.253036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:46:41.258537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e247-51c4-4f9d-b72c-b8ec2385b649 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:41.258912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e247-51c4-4f9d-b72c-b8ec2385b649 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:41.259088 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1e247-51c4-4f9d-b72c-b8ec2385b649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:41.281222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0bf1e247-51c4-4f9d-b72c-b8ec2385b649 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:41.282789 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0bf1e247-51c4-4f9d-b72c-b8ec2385b649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:41.290595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 14:46:41.571705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebdcfb-17b3-4073-9096-4aa0e43ea837 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:41.584066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebdcfb-17b3-4073-9096-4aa0e43ea837 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:41.588750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee3087-7a31-4778-b648-6e0d40097985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:41.589361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee3087-7a31-4778-b648-6e0d40097985 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:41.589640 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee3087-7a31-4778-b648-6e0d40097985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:41.589912 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee3087-7a31-4778-b648-6e0d40097985 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:41.597328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee3087-7a31-4778-b648-6e0d40097985 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:41.599122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee3087-7a31-4778-b648-6e0d40097985 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:41.607649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Mon Oct 31 14:46:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 14:46:41.613021 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1e247-51c4-4f9d-b72c-b8ec2385b649 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:41.623163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1e247-51c4-4f9d-b72c-b8ec2385b649 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:41.627471 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468094a-a446-4c6e-9eca-f53cd33c04d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:41.628088 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468094a-a446-4c6e-9eca-f53cd33c04d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:41.628368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468094a-a446-4c6e-9eca-f53cd33c04d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:41.628643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468094a-a446-4c6e-9eca-f53cd33c04d2 admin admin] PATH_INFO: `/v3/users/6869ed0ef88b494189d119f94f621131` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:41.629976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468094a-a446-4c6e-9eca-f53cd33c04d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=6869ed0ef88b494189d119f94f621131)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:41.631791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468094a-a446-4c6e-9eca-f53cd33c04d2 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:41.633326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Mon Oct 31 14:46:41 2022] GET /identity/v3/users/6869ed0ef88b494189d119f94f621131 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:43.834576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57805547-2dfa-48a4-993d-21f6953776e0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:43.835110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57805547-2dfa-48a4-993d-21f6953776e0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:43.835110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57805547-2dfa-48a4-993d-21f6953776e0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:43.836438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:46:43.841703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe56443-1a77-437e-ba5e-962ce7074a49 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:43.842120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe56443-1a77-437e-ba5e-962ce7074a49 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:43.842243 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe56443-1a77-437e-ba5e-962ce7074a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:43.860201 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-6fe56443-1a77-437e-ba5e-962ce7074a49 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:43.861472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6fe56443-1a77-437e-ba5e-962ce7074a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:43.892687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b240d7-9286-49bc-bc2c-617749148eb2 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:43.892962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b240d7-9286-49bc-bc2c-617749148eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:43.893230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b240d7-9286-49bc-bc2c-617749148eb2 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:43.894584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:46:43.899424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ee60d-3eb0-405c-8c16-ab2079f08a99 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:43.899765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ee60d-3eb0-405c-8c16-ab2079f08a99 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:43.900107 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ee60d-3eb0-405c-8c16-ab2079f08a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:43.942024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG passlib.handlers.bcrypt [None req-2b5ee60d-3eb0-405c-8c16-ab2079f08a99 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81683) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 31 14:46:43.942411 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG passlib.handlers.bcrypt [None req-2b5ee60d-3eb0-405c-8c16-ab2079f08a99 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81683) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 31 14:46:43.946188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:46:43.991546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2b5ee60d-3eb0-405c-8c16-ab2079f08a99 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:43.993140 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2b5ee60d-3eb0-405c-8c16-ab2079f08a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:44.091046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:46:44.216045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe56443-1a77-437e-ba5e-962ce7074a49 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:44.239482 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:44.316762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe56443-1a77-437e-ba5e-962ce7074a49 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:44.349399 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dd849-55ca-47d3-809e-332cdf1924ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:44.349966 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dd849-55ca-47d3-809e-332cdf1924ba None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:44.350239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dd849-55ca-47d3-809e-332cdf1924ba None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:44.350506 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67dd849-55ca-47d3-809e-332cdf1924ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:44.357582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ee60d-3eb0-405c-8c16-ab2079f08a99 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:44.362896 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67dd849-55ca-47d3-809e-332cdf1924ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-e67dd849-55ca-47d3-809e-332cdf1924ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:46:44.371895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:46:44.372855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:46:44.373721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:46:44.373721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:46:44.373721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:46:44.373721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:46:44.373721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:46:44.373721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:46:44.373721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:46:44.373721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:46:44.373721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:46:44.373721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:46:44.373721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:46:44.373721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:46:44.373721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:46:44.378779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dd849-55ca-47d3-809e-332cdf1924ba None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:44.458428 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ee60d-3eb0-405c-8c16-ab2079f08a99 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:44.458902 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:44.460766 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:44.477149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67dd849-55ca-47d3-809e-332cdf1924ba None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:44.495115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1670cb0-60db-4554-863f-913643cbe4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:44.495979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1670cb0-60db-4554-863f-913643cbe4cd None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:44.496260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1670cb0-60db-4554-863f-913643cbe4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:44.496532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1670cb0-60db-4554-863f-913643cbe4cd None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:44.497593 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1670cb0-60db-4554-863f-913643cbe4cd None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:44.499032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1670cb0-60db-4554-863f-913643cbe4cd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:44.511831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44961f33-599c-4f01-836b-9d567cf3bb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:44.512440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44961f33-599c-4f01-836b-9d567cf3bb46 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:44.516939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44961f33-599c-4f01-836b-9d567cf3bb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:44.516939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44961f33-599c-4f01-836b-9d567cf3bb46 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:44.516939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44961f33-599c-4f01-836b-9d567cf3bb46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:46:44.516939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44961f33-599c-4f01-836b-9d567cf3bb46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:44.516939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44961f33-599c-4f01-836b-9d567cf3bb46 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:44.527726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:46:44.533673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44961f33-599c-4f01-836b-9d567cf3bb46 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:44.602318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.sql.core [None req-c1670cb0-60db-4554-863f-913643cbe4cd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 14:46:44.602318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 14:46:44.602318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [parameters: {'id': '501b91e0a9284675a5e38b5f651072f4', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 14:46:44.602318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81683) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c1670cb0-60db-4554-863f-913643cbe4cd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application conn.query(q) Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:46:44.621901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result.read() Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 14:46:44.622717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application yield resource Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise self.value Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application session.commit() Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 14:46:44.623770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.session.flush() Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application compat.raise_( Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 14:46:44.624802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 14:46:44.625777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application conn.query(q) Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result.read() Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 14:46:44.626886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [parameters: {'id': '501b91e0a9284675a5e38b5f651072f4', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 14:46:44.628564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:46:44.630179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 8/16] 10.222.0.45 () {60 vars in 1137 bytes} [Mon Oct 31 14:46:44 2022] POST /identity/v3/domains => generated 190 bytes in 266 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:46:44.631980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1670cb0-60db-4554-863f-913643cbe4cd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:44.636920 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44961f33-599c-4f01-836b-9d567cf3bb46 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:44.671578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52afcde-a12b-4f67-9ee3-2afeb3202c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:44.672201 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52afcde-a12b-4f67-9ee3-2afeb3202c51 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:44.672478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52afcde-a12b-4f67-9ee3-2afeb3202c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:44.672744 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52afcde-a12b-4f67-9ee3-2afeb3202c51 None admin] PATH_INFO: `/v3/users/6869ed0ef88b494189d119f94f621131` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:44.673882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52afcde-a12b-4f67-9ee3-2afeb3202c51 None admin] RBAC: Authorizing `identity:get_user(user_id=6869ed0ef88b494189d119f94f621131)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:44.675338 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52afcde-a12b-4f67-9ee3-2afeb3202c51 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:44.676886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:46:44 2022] GET /identity/v3/users/6869ed0ef88b494189d119f94f621131 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:46:44.682428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52afcde-a12b-4f67-9ee3-2afeb3202c51 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:44.696213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:44.730122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1670cb0-60db-4554-863f-913643cbe4cd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:44.766150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c56923-2589-44fa-b935-b9981c1d4e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:44.767105 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c56923-2589-44fa-b935-b9981c1d4e4e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:44.767379 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c56923-2589-44fa-b935-b9981c1d4e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:44.767649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c56923-2589-44fa-b935-b9981c1d4e4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:44.781896 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52afcde-a12b-4f67-9ee3-2afeb3202c51 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:44.785500 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c56923-2589-44fa-b935-b9981c1d4e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:44.786961 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c56923-2589-44fa-b935-b9981c1d4e4e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-98c56923-2589-44fa-b935-b9981c1d4e4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:46:44.802773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:46:44.803673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:46:44.804722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:46:44.804722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:46:44.804722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:46:44.804722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:46:44.810334 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c56923-2589-44fa-b935-b9981c1d4e4e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:44.817768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a54f7-601a-4a01-8ef5-e127d8d10606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:44.818393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a54f7-601a-4a01-8ef5-e127d8d10606 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:44.818704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a54f7-601a-4a01-8ef5-e127d8d10606 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:44.818972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a54f7-601a-4a01-8ef5-e127d8d10606 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:44.820062 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a54f7-601a-4a01-8ef5-e127d8d10606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:44.821529 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a54f7-601a-4a01-8ef5-e127d8d10606 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:44.823662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:46:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:46:44.829106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a54f7-601a-4a01-8ef5-e127d8d10606 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:44.833452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:44.910636 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:44.912413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c56923-2589-44fa-b935-b9981c1d4e4e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:44.928902 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a54f7-601a-4a01-8ef5-e127d8d10606 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:44.946372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39131d38-d56f-46df-b177-315d4cb7d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:44.947528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39131d38-d56f-46df-b177-315d4cb7d75f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:44.947808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39131d38-d56f-46df-b177-315d4cb7d75f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:44.948076 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39131d38-d56f-46df-b177-315d4cb7d75f None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:44.948711 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39131d38-d56f-46df-b177-315d4cb7d75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:46:44.949008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39131d38-d56f-46df-b177-315d4cb7d75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:44.950529 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39131d38-d56f-46df-b177-315d4cb7d75f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:44.963427 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49c89b-1299-4b7a-9525-c375de22b6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:44.964078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49c89b-1299-4b7a-9525-c375de22b6f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:44.964356 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49c89b-1299-4b7a-9525-c375de22b6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:44.964629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49c89b-1299-4b7a-9525-c375de22b6f5 None admin] PATH_INFO: `/v3/domains/default/users/6869ed0ef88b494189d119f94f621131/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:44.966573 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49c89b-1299-4b7a-9525-c375de22b6f5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6869ed0ef88b494189d119f94f621131, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:44.968000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49c89b-1299-4b7a-9525-c375de22b6f5 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:45.018912 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 10/20] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:45.212970 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 11/21] 10.222.0.45 () {58 vars in 1361 bytes} [Mon Oct 31 14:46:44 2022] PUT /identity/v3/domains/default/users/6869ed0ef88b494189d119f94f621131/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:46:47.442774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e865931-c6ac-45a1-97b0-ce447e6329ef None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:47.443288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e865931-c6ac-45a1-97b0-ce447e6329ef None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:47.443288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e865931-c6ac-45a1-97b0-ce447e6329ef None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:47.444899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 11/22] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:46:47.451188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c18561-4f6a-4fc4-8151-d8b70abde254 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:47.451592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c18561-4f6a-4fc4-8151-d8b70abde254 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:47.451761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c18561-4f6a-4fc4-8151-d8b70abde254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:47.479145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-91c18561-4f6a-4fc4-8151-d8b70abde254 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:47.480709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-91c18561-4f6a-4fc4-8151-d8b70abde254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:47.575576 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 12/23] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:46:47.620497 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1e261-47cc-4cfa-ade7-5d6e97db9869 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:47.620789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1e261-47cc-4cfa-ade7-5d6e97db9869 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:47.621035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1e261-47cc-4cfa-ade7-5d6e97db9869 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:47.622675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:46:47.628184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59ee8e-a21f-4f13-a084-7772c9b96865 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:47.628470 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59ee8e-a21f-4f13-a084-7772c9b96865 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:47.628740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59ee8e-a21f-4f13-a084-7772c9b96865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:47.656188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-da59ee8e-a21f-4f13-a084-7772c9b96865 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:47.657468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-da59ee8e-a21f-4f13-a084-7772c9b96865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:47.734567 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:47.744238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 13/25] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:46:48.006648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1e261-47cc-4cfa-ade7-5d6e97db9869 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:48.115997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:48.138004 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1e261-47cc-4cfa-ade7-5d6e97db9869 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:48.177889 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711e144-b342-4f7d-aae6-e152b06be2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:48.178520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e144-b342-4f7d-aae6-e152b06be2df None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:48.178796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e144-b342-4f7d-aae6-e152b06be2df None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:48.179065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e144-b342-4f7d-aae6-e152b06be2df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:48.200353 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711e144-b342-4f7d-aae6-e152b06be2df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:46:48.204775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc7c0b-cef2-4583-8dd0-fb0097d3a274 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:48.205059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc7c0b-cef2-4583-8dd0-fb0097d3a274 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:48.205351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc7c0b-cef2-4583-8dd0-fb0097d3a274 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:48.209766 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 14/26] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:46:48.214988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818c770-249d-4660-a828-68332e661783 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:48.215269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818c770-249d-4660-a828-68332e661783 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:48.215537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818c770-249d-4660-a828-68332e661783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1711e144-b342-4f7d-aae6-e152b06be2df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:46:48.218994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:46:48.219817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:46:48.220537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:46:48.220537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:46:48.220537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:46:48.220537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:46:48.220537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:46:48.220537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:46:48.220537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:46:48.220537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:46:48.220537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:46:48.220537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:46:48.220537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:46:48.220537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:46:48.222416 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 13/27] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:46:48.231170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711e144-b342-4f7d-aae6-e152b06be2df None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:48.249346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-b818c770-249d-4660-a828-68332e661783 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:48.250544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b818c770-249d-4660-a828-68332e661783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:48.405428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 15/28] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:46:48.406332 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818c770-249d-4660-a828-68332e661783 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:48.415196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711e144-b342-4f7d-aae6-e152b06be2df None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:48.480830 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4198c-d194-4103-887c-d1d9d14b3c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:48.481457 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4198c-d194-4103-887c-d1d9d14b3c2f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:48.481867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4198c-d194-4103-887c-d1d9d14b3c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:48.482145 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4198c-d194-4103-887c-d1d9d14b3c2f None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:48.482818 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4198c-d194-4103-887c-d1d9d14b3c2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:46:48.483122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4198c-d194-4103-887c-d1d9d14b3c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:48.484498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4198c-d194-4103-887c-d1d9d14b3c2f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:48.497782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 14/29] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:48.499474 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ebbb5-8f6a-4fd0-847a-225b12242436 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:48.499896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ebbb5-8f6a-4fd0-847a-225b12242436 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:48.500275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ebbb5-8f6a-4fd0-847a-225b12242436 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:48.505058 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 15/30] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:46:48.505855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ebbb5-8f6a-4fd0-847a-225b12242436 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:48.515448 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:48.645693 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818c770-249d-4660-a828-68332e661783 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:48.649450 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ebbb5-8f6a-4fd0-847a-225b12242436 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:48.694716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:48.700512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ca5b9-fd34-4da6-b68b-102712cd5185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:48.701153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ca5b9-fd34-4da6-b68b-102712cd5185 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:48.701463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ca5b9-fd34-4da6-b68b-102712cd5185 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:48.701733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ca5b9-fd34-4da6-b68b-102712cd5185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:48.708947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dafe9-324a-4cc2-bfa7-8bed373105e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:48.709596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dafe9-324a-4cc2-bfa7-8bed373105e8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:48.712871 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dafe9-324a-4cc2-bfa7-8bed373105e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:48.712871 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dafe9-324a-4cc2-bfa7-8bed373105e8 None admin] PATH_INFO: `/v3/users/6869ed0ef88b494189d119f94f621131` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:48.712871 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dafe9-324a-4cc2-bfa7-8bed373105e8 None admin] RBAC: Authorizing `identity:get_user(user_id=6869ed0ef88b494189d119f94f621131)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:48.713972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dafe9-324a-4cc2-bfa7-8bed373105e8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:48.714136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ca5b9-fd34-4da6-b68b-102712cd5185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:48.715898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ca5b9-fd34-4da6-b68b-102712cd5185 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:48.719499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 16/31] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:46:48 2022] GET /identity/v3/users/6869ed0ef88b494189d119f94f621131 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:48.720740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7316c8c-2fe3-4c1b-b007-15524dcb2763 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:48.721071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7316c8c-2fe3-4c1b-b007-15524dcb2763 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:48.721376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7316c8c-2fe3-4c1b-b007-15524dcb2763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-c51ca5b9-fd34-4da6-b68b-102712cd5185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:46:48.735053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:46:48.735936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:46:48.736732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:46:48.736732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:46:48.736732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:46:48.738726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 16/32] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:46:48.739690 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ca5b9-fd34-4da6-b68b-102712cd5185 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:48.747168 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a7316c8c-2fe3-4c1b-b007-15524dcb2763 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:48.748470 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a7316c8c-2fe3-4c1b-b007-15524dcb2763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:48.823015 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:48.829759 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 17/33] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:46:48.830765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7316c8c-2fe3-4c1b-b007-15524dcb2763 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:48.867624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ca5b9-fd34-4da6-b68b-102712cd5185 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:48.916445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191dfb-43f3-4888-aa67-5b9c1411872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:48.917516 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191dfb-43f3-4888-aa67-5b9c1411872f None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:48.920229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191dfb-43f3-4888-aa67-5b9c1411872f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:48.920674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0191dfb-43f3-4888-aa67-5b9c1411872f None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:48.921580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191dfb-43f3-4888-aa67-5b9c1411872f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:48.926551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0191dfb-43f3-4888-aa67-5b9c1411872f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:48.960915 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7316c8c-2fe3-4c1b-b007-15524dcb2763 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:49.004735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d49175-d3ef-4c47-946c-918d8a4aefdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:49.005420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d49175-d3ef-4c47-946c-918d8a4aefdc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.005763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d49175-d3ef-4c47-946c-918d8a4aefdc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.006038 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d49175-d3ef-4c47-946c-918d8a4aefdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.007421 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d49175-d3ef-4c47-946c-918d8a4aefdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:49.008908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d49175-d3ef-4c47-946c-918d8a4aefdc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:49.011891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 18/34] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:46:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:49.012518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d49175-d3ef-4c47-946c-918d8a4aefdc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:49.062486 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 17/35] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Oct 31 14:46:48 2022] POST /identity/v3/roles => generated 225 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:49.063110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191dfb-43f3-4888-aa67-5b9c1411872f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:49.094979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:49.140401 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:49.142536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d49175-d3ef-4c47-946c-918d8a4aefdc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:49.189779 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd20b8-1ae1-4766-b63f-e7bdd2cf3445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:49.191017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd20b8-1ae1-4766-b63f-e7bdd2cf3445 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.191293 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd20b8-1ae1-4766-b63f-e7bdd2cf3445 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.191716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd20b8-1ae1-4766-b63f-e7bdd2cf3445 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.192497 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd20b8-1ae1-4766-b63f-e7bdd2cf3445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:46:49.192800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd20b8-1ae1-4766-b63f-e7bdd2cf3445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:49.194204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd20b8-1ae1-4766-b63f-e7bdd2cf3445 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:49.203420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0191dfb-43f3-4888-aa67-5b9c1411872f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:49.209996 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 19/36] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:49.213442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b851e-810a-453c-90bb-b36db50cff4a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.213703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b851e-810a-453c-90bb-b36db50cff4a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.214033 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b851e-810a-453c-90bb-b36db50cff4a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.215507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 20/37] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:46:49.219735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b851e-810a-453c-90bb-b36db50cff4a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:49.254479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9de8c7-5e70-4826-a85e-b49ed2d58f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:49.255370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9de8c7-5e70-4826-a85e-b49ed2d58f35 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.256112 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9de8c7-5e70-4826-a85e-b49ed2d58f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.256495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9de8c7-5e70-4826-a85e-b49ed2d58f35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.257603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9de8c7-5e70-4826-a85e-b49ed2d58f35 None admin] RBAC: Adding query filter params (role.id=c62ffefc63e74a1280bef2b6a22202ad, scope.domain.id=default, user.id=6869ed0ef88b494189d119f94f621131) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:46:49.257915 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9de8c7-5e70-4826-a85e-b49ed2d58f35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:49.261034 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9de8c7-5e70-4826-a85e-b49ed2d58f35 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:49.271420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 18/38] 10.222.0.45 () {56 vars in 1322 bytes} [Mon Oct 31 14:46:49 2022] GET /identity/v3/role_assignments?user.id=6869ed0ef88b494189d119f94f621131&scope.domain.id=default&role.id=c62ffefc63e74a1280bef2b6a22202ad => generated 530 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:49.272822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698fe5b-2c48-4969-8a05-89d2799a67c8 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.273018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698fe5b-2c48-4969-8a05-89d2799a67c8 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.273315 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698fe5b-2c48-4969-8a05-89d2799a67c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.321083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0698fe5b-2c48-4969-8a05-89d2799a67c8 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:49.324372 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0698fe5b-2c48-4969-8a05-89d2799a67c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:49.407418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b851e-810a-453c-90bb-b36db50cff4a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:49.439279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 19/39] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:46:49.440219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698fe5b-2c48-4969-8a05-89d2799a67c8 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:49.455761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:49.463378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144b982-af05-449d-8f2b-f6bf95a4c3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:49.464211 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144b982-af05-449d-8f2b-f6bf95a4c3a3 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.464533 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144b982-af05-449d-8f2b-f6bf95a4c3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.464905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144b982-af05-449d-8f2b-f6bf95a4c3a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.465685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144b982-af05-449d-8f2b-f6bf95a4c3a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:49.467569 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144b982-af05-449d-8f2b-f6bf95a4c3a3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:49.488936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:49.563095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698fe5b-2c48-4969-8a05-89d2799a67c8 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:49.596166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d7930-6b45-4b2a-b67c-f237bd43cb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:49.596778 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d7930-6b45-4b2a-b67c-f237bd43cb93 None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.597058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d7930-6b45-4b2a-b67c-f237bd43cb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.597353 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d7930-6b45-4b2a-b67c-f237bd43cb93 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.598036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d7930-6b45-4b2a-b67c-f237bd43cb93 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:49.599413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d7930-6b45-4b2a-b67c-f237bd43cb93 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:49.682797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 20/40] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Oct 31 14:46:49 2022] POST /identity/v3/roles => generated 219 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:49.684722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1aaae-f80b-471a-a044-57a4013aec73 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.685130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1aaae-f80b-471a-a044-57a4013aec73 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.685572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1aaae-f80b-471a-a044-57a4013aec73 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.686952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 21/41] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:46:49.700519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93090-8549-4554-ab54-c08622b53d2f None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.701178 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93090-8549-4554-ab54-c08622b53d2f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.701700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada93090-8549-4554-ab54-c08622b53d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.725484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-ada93090-8549-4554-ab54-c08622b53d2f None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:49.727170 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ada93090-8549-4554-ab54-c08622b53d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:49.727857 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 21/42] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:46:49 2022] POST /identity/v3/projects => generated 301 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:49.738836 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144b982-af05-449d-8f2b-f6bf95a4c3a3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:49.882583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144b982-af05-449d-8f2b-f6bf95a4c3a3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:49.927584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b01ef-fd9a-4db5-a519-60398ab2753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:49.928246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b01ef-fd9a-4db5-a519-60398ab2753b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:49.928533 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b01ef-fd9a-4db5-a519-60398ab2753b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:49.929654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b01ef-fd9a-4db5-a519-60398ab2753b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:49.931039 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b01ef-fd9a-4db5-a519-60398ab2753b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:49.933395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b01ef-fd9a-4db5-a519-60398ab2753b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:49.934972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 22/43] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:46:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:49.940928 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b01ef-fd9a-4db5-a519-60398ab2753b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:49.951570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 22/44] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:46:50.001502 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:50.052885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b01ef-fd9a-4db5-a519-60398ab2753b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:50.087131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403330f-c702-4753-8644-bf867baada54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:50.087855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403330f-c702-4753-8644-bf867baada54 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:50.088135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403330f-c702-4753-8644-bf867baada54 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:50.088402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403330f-c702-4753-8644-bf867baada54 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:50.089045 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403330f-c702-4753-8644-bf867baada54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:50.090540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403330f-c702-4753-8644-bf867baada54 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:50.217318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 23/45] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:46:49 2022] POST /identity/v3/projects => generated 312 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:46:50.221166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada93090-8549-4554-ab54-c08622b53d2f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:50.252289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:50.332270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada93090-8549-4554-ab54-c08622b53d2f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:50.370571 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd8232-5cb4-46fa-9604-40d9b509d37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:50.371189 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd8232-5cb4-46fa-9604-40d9b509d37c None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:50.371472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd8232-5cb4-46fa-9604-40d9b509d37c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:50.371750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd8232-5cb4-46fa-9604-40d9b509d37c None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:50.372432 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd8232-5cb4-46fa-9604-40d9b509d37c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:50.373873 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd8232-5cb4-46fa-9604-40d9b509d37c None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:50.466254 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 23/46] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Oct 31 14:46:50 2022] POST /identity/v3/roles => generated 223 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:52.372403 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32f187-e292-4685-9109-fd3b4bcfa8d4 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:52.439206 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32f187-e292-4685-9109-fd3b4bcfa8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:52.439206 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32f187-e292-4685-9109-fd3b4bcfa8d4 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:52.439206 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 24/47] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:46:52.439499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520d6ea-b796-4410-8f28-973b19fd0cd7 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:52.439499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520d6ea-b796-4410-8f28-973b19fd0cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:52.439499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520d6ea-b796-4410-8f28-973b19fd0cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:52.439499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-b520d6ea-b796-4410-8f28-973b19fd0cd7 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:52.439499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b520d6ea-b796-4410-8f28-973b19fd0cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:52.464596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 24/48] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:46:52.733970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32f187-e292-4685-9109-fd3b4bcfa8d4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:52.828242 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:52.831839 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32f187-e292-4685-9109-fd3b4bcfa8d4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:52.863565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f6416-156e-47ce-9294-4130a657392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:52.864178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f6416-156e-47ce-9294-4130a657392d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:52.864457 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f6416-156e-47ce-9294-4130a657392d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:52.864729 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f6416-156e-47ce-9294-4130a657392d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:52.865838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f6416-156e-47ce-9294-4130a657392d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:52.867272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f6416-156e-47ce-9294-4130a657392d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:52.869441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 25/49] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:46:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:52.875117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520d6ea-b796-4410-8f28-973b19fd0cd7 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:52.892925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:52.973053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520d6ea-b796-4410-8f28-973b19fd0cd7 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:53.007128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42254a1-b10a-46ef-a025-0364d18b1cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:53.007676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42254a1-b10a-46ef-a025-0364d18b1cc5 None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:53.007959 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42254a1-b10a-46ef-a025-0364d18b1cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:53.008232 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42254a1-b10a-46ef-a025-0364d18b1cc5 None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:53.008887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42254a1-b10a-46ef-a025-0364d18b1cc5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:53.010978 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42254a1-b10a-46ef-a025-0364d18b1cc5 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:53.141092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 25/50] 10.222.0.45 () {60 vars in 1140 bytes} [Mon Oct 31 14:46:52 2022] POST /identity/v3/projects => generated 298 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:55.268957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b88e2-4e93-44cf-95d9-c9dd7a89cdf0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:55.269481 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b88e2-4e93-44cf-95d9-c9dd7a89cdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:55.269481 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b88e2-4e93-44cf-95d9-c9dd7a89cdf0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:55.270787 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 26/51] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:46:55.276753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447ff8-0355-44a9-9352-83a953014c5a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:55.277122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447ff8-0355-44a9-9352-83a953014c5a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:55.277306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447ff8-0355-44a9-9352-83a953014c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:55.296387 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-66447ff8-0355-44a9-9352-83a953014c5a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:55.297618 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-66447ff8-0355-44a9-9352-83a953014c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:55.357070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:55.362271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 26/52] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:46:55.633758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b88e2-4e93-44cf-95d9-c9dd7a89cdf0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:55.732815 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b88e2-4e93-44cf-95d9-c9dd7a89cdf0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:55.765318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea58593-bd6f-4c62-aeee-07b01e180780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:55.765946 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea58593-bd6f-4c62-aeee-07b01e180780 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:55.766230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea58593-bd6f-4c62-aeee-07b01e180780 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:55.766506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea58593-bd6f-4c62-aeee-07b01e180780 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:55.767615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea58593-bd6f-4c62-aeee-07b01e180780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:55.769066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea58593-bd6f-4c62-aeee-07b01e180780 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:55.770638 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 27/53] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:46:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:46:55.776586 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66447ff8-0355-44a9-9352-83a953014c5a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:55.872969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66447ff8-0355-44a9-9352-83a953014c5a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:55.907034 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e6d50-5361-42b3-9ab7-57b95c247905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:55.907577 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e6d50-5361-42b3-9ab7-57b95c247905 None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:55.907856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e6d50-5361-42b3-9ab7-57b95c247905 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:55.908125 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e6d50-5361-42b3-9ab7-57b95c247905 None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:55.908764 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e6d50-5361-42b3-9ab7-57b95c247905 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:46:55.910240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e6d50-5361-42b3-9ab7-57b95c247905 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:46:56.028460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 27/54] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:46:55 2022] POST /identity/v3/users => generated 275 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:46:59.243922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176d30f-5e30-46f5-b1d5-a1047aa59ce0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:59.244423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176d30f-5e30-46f5-b1d5-a1047aa59ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:59.244423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176d30f-5e30-46f5-b1d5-a1047aa59ce0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:59.245923 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 28/55] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:46:59.254586 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e385a-80d7-47c0-a607-987b4620294d None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:59.255382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e385a-80d7-47c0-a607-987b4620294d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:59.255872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e385a-80d7-47c0-a607-987b4620294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:59.278677 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-cc2e385a-80d7-47c0-a607-987b4620294d None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:59.280432 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-cc2e385a-80d7-47c0-a607-987b4620294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:59.343632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:59.362494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 28/56] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:46:59.551629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cce875-aea4-496e-a145-6fb4003951b0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:59.551963 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cce875-aea4-496e-a145-6fb4003951b0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:59.552138 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cce875-aea4-496e-a145-6fb4003951b0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:59.553633 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 29/57] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:46:59.563265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4b948-d452-45ef-9637-097cabff424e None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:59.563557 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4b948-d452-45ef-9637-097cabff424e None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:59.563820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4b948-d452-45ef-9637-097cabff424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:59.571137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995bf52-715b-4c5a-b76c-814ca5e25abc None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:59.572696 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995bf52-715b-4c5a-b76c-814ca5e25abc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:59.573215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995bf52-715b-4c5a-b76c-814ca5e25abc None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:59.574806 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 30/58] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:46:59.580147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369168e7-08fd-458e-ab0c-1cc86828ef92 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:59.580676 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369168e7-08fd-458e-ab0c-1cc86828ef92 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:59.581160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369168e7-08fd-458e-ab0c-1cc86828ef92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:59.584043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-c3c4b948-d452-45ef-9637-097cabff424e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:59.585493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c3c4b948-d452-45ef-9637-097cabff424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:59.618140 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-369168e7-08fd-458e-ab0c-1cc86828ef92 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:46:59.623213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-369168e7-08fd-458e-ab0c-1cc86828ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:46:59.678383 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:59.700704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 29/59] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:46:59.702034 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4b948-d452-45ef-9637-097cabff424e None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:59.738795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 31/60] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:46:59.824267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4b948-d452-45ef-9637-097cabff424e None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:46:59.844595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:46:59.866454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0382ed4-a196-4523-8a8b-a8279ee6b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:46:59.867101 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0382ed4-a196-4523-8a8b-a8279ee6b6bf None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:59.867377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0382ed4-a196-4523-8a8b-a8279ee6b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:59.867648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0382ed4-a196-4523-8a8b-a8279ee6b6bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:59.879701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0382ed4-a196-4523-8a8b-a8279ee6b6bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-e0382ed4-a196-4523-8a8b-a8279ee6b6bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:46:59.885503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:46:59.886455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:46:59.887439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:46:59.887439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:46:59.887439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:46:59.887439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:46:59.887439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:46:59.887439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:46:59.887439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:46:59.887439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:46:59.887439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:46:59.887439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:46:59.887439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:46:59.887439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:46:59.887439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:46:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:46:59.893734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369168e7-08fd-458e-ab0c-1cc86828ef92 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:46:59.977658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d20b4-afca-4bbb-b688-3a33b62202fb None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:59.978027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d20b4-afca-4bbb-b688-3a33b62202fb None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:59.978277 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d20b4-afca-4bbb-b688-3a33b62202fb None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:46:59.979644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 31/62] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:46:59.984987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418d374-69dd-4e94-9c7e-5fbf3062123b None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:46:59.985268 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418d374-69dd-4e94-9c7e-5fbf3062123b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:46:59.985591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418d374-69dd-4e94-9c7e-5fbf3062123b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:00.015926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-1418d374-69dd-4e94-9c7e-5fbf3062123b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:00.018052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-1418d374-69dd-4e94-9c7e-5fbf3062123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:00.041957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369168e7-08fd-458e-ab0c-1cc86828ef92 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:00.112398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080a987-5a08-4c35-8ae2-21222467446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:00.113261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080a987-5a08-4c35-8ae2-21222467446b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:00.113756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080a987-5a08-4c35-8ae2-21222467446b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:00.114173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080a987-5a08-4c35-8ae2-21222467446b None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:00.115061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080a987-5a08-4c35-8ae2-21222467446b None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:00.115591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080a987-5a08-4c35-8ae2-21222467446b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:00.117203 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080a987-5a08-4c35-8ae2-21222467446b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:00.127893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 32/63] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:46:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:00.128828 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080a987-5a08-4c35-8ae2-21222467446b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:00.134599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 32/64] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:00.134599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418d374-69dd-4e94-9c7e-5fbf3062123b None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:00.259000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418d374-69dd-4e94-9c7e-5fbf3062123b None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:00.262075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:00.268677 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:00.297481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550255e-e044-4ca2-8242-a09ccbc27ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:00.298120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550255e-e044-4ca2-8242-a09ccbc27ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:00.298403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550255e-e044-4ca2-8242-a09ccbc27ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:00.298678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550255e-e044-4ca2-8242-a09ccbc27ee3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:00.310386 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550255e-e044-4ca2-8242-a09ccbc27ee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-9550255e-e044-4ca2-8242-a09ccbc27ee3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:00.315326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:00.316203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 33/65] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:47:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:00.321675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550255e-e044-4ca2-8242-a09ccbc27ee3 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:00.356973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080a987-5a08-4c35-8ae2-21222467446b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:00.396461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09992bf6-5a9b-421f-b075-c62a0a8c5429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:00.397032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992bf6-5a9b-421f-b075-c62a0a8c5429 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:00.397314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992bf6-5a9b-421f-b075-c62a0a8c5429 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:00.397879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09992bf6-5a9b-421f-b075-c62a0a8c5429 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:00.409652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09992bf6-5a9b-421f-b075-c62a0a8c5429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-09992bf6-5a9b-421f-b075-c62a0a8c5429 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:00.416341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:00.417184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:00.418246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:00.418246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:00.418246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:00.418246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:00.418246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:00.418246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:00.418246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:00.418246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:00.418246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:00.418246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:00.418246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:00.418246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:00.418246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 33/66] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:47:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:00.418873 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e23a87-dabf-4dfc-b245-ddf4f7e422cf None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:00.418979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e23a87-dabf-4dfc-b245-ddf4f7e422cf None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:00.419252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e23a87-dabf-4dfc-b245-ddf4f7e422cf None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:00.420495 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 34/67] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:00.421192 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e23a87-dabf-4dfc-b245-ddf4f7e422cf None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:00.428022 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550255e-e044-4ca2-8242-a09ccbc27ee3 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:00.461138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a024ce-47e8-4fc7-b260-bf1dc9f68e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:00.461789 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a024ce-47e8-4fc7-b260-bf1dc9f68e92 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:00.462609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a024ce-47e8-4fc7-b260-bf1dc9f68e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:00.462877 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a024ce-47e8-4fc7-b260-bf1dc9f68e92 None admin] PATH_INFO: `/v3/users/796510ac3b2b4676b340c1699bc540e1` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:00.475836 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a024ce-47e8-4fc7-b260-bf1dc9f68e92 None admin] RBAC: Authorizing `identity:get_user(user_id=796510ac3b2b4676b340c1699bc540e1)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:00.477303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a024ce-47e8-4fc7-b260-bf1dc9f68e92 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:00.479584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 34/68] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:00 2022] GET /identity/v3/users/796510ac3b2b4676b340c1699bc540e1 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:00.480339 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a024ce-47e8-4fc7-b260-bf1dc9f68e92 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:00.503549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:00.511702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:00.524062 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e23a87-dabf-4dfc-b245-ddf4f7e422cf None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:00.558915 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959fa33-cfde-4c99-b371-850c3af2e6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:00.559530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959fa33-cfde-4c99-b371-850c3af2e6af None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:00.559829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959fa33-cfde-4c99-b371-850c3af2e6af None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:00.560084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959fa33-cfde-4c99-b371-850c3af2e6af None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:00.560744 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959fa33-cfde-4c99-b371-850c3af2e6af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:00.561048 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959fa33-cfde-4c99-b371-850c3af2e6af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:00.562448 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959fa33-cfde-4c99-b371-850c3af2e6af None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:00.570299 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 35/69] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:00.571085 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959fa33-cfde-4c99-b371-850c3af2e6af None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:00.578531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a024ce-47e8-4fc7-b260-bf1dc9f68e92 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:00.612830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c61a1c-f55d-4db5-8649-3bd2a4bbbd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:00.613486 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c61a1c-f55d-4db5-8649-3bd2a4bbbd44 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:00.613770 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c61a1c-f55d-4db5-8649-3bd2a4bbbd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:00.614046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c61a1c-f55d-4db5-8649-3bd2a4bbbd44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:00.615156 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c61a1c-f55d-4db5-8649-3bd2a4bbbd44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:00.616635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c61a1c-f55d-4db5-8649-3bd2a4bbbd44 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:00.618761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 35/70] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:00.620308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744f1c8-4251-41f2-bc1f-87ea6a8ef3b9 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:00.620614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744f1c8-4251-41f2-bc1f-87ea6a8ef3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:00.620894 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744f1c8-4251-41f2-bc1f-87ea6a8ef3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:00.638451 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-5744f1c8-4251-41f2-bc1f-87ea6a8ef3b9 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:00.639835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5744f1c8-4251-41f2-bc1f-87ea6a8ef3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:00.670698 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959fa33-cfde-4c99-b371-850c3af2e6af None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:00.703846 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233abfa-c71f-4a3b-80f1-bed04a13263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:00.704452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233abfa-c71f-4a3b-80f1-bed04a13263f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:00.704798 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233abfa-c71f-4a3b-80f1-bed04a13263f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:00.705087 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233abfa-c71f-4a3b-80f1-bed04a13263f None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:00.705776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233abfa-c71f-4a3b-80f1-bed04a13263f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:00.706084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233abfa-c71f-4a3b-80f1-bed04a13263f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:00.706357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 36/71] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:00.707486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233abfa-c71f-4a3b-80f1-bed04a13263f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:00.714128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744f1c8-4251-41f2-bc1f-87ea6a8ef3b9 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:00.716245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 36/72] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:00.721454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233abfa-c71f-4a3b-80f1-bed04a13263f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:00.737371 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:00.737848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:00.818557 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744f1c8-4251-41f2-bc1f-87ea6a8ef3b9 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:00.827771 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233abfa-c71f-4a3b-80f1-bed04a13263f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:00.854903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63bde1-d77a-4997-ad04-9d31072f9e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:00.855780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63bde1-d77a-4997-ad04-9d31072f9e35 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:00.856239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63bde1-d77a-4997-ad04-9d31072f9e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:00.856667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63bde1-d77a-4997-ad04-9d31072f9e35 None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:00.857999 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63bde1-d77a-4997-ad04-9d31072f9e35 None admin] RBAC: Authorizing `identity:get_project(project_id=86030394acc448f88cf92161d1688d4d)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:00.859453 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63bde1-d77a-4997-ad04-9d31072f9e35 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:00.864719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240616a-fda4-493b-a161-7f63f0363ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:00.865423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240616a-fda4-493b-a161-7f63f0363ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:00.866117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240616a-fda4-493b-a161-7f63f0363ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:00.866231 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 37/73] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:00 2022] GET /identity/v3/projects/86030394acc448f88cf92161d1688d4d => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:00.866317 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240616a-fda4-493b-a161-7f63f0363ee0 None admin] PATH_INFO: `/v3/users/6869ed0ef88b494189d119f94f621131` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:00.866712 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63bde1-d77a-4997-ad04-9d31072f9e35 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:00.867242 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240616a-fda4-493b-a161-7f63f0363ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=6869ed0ef88b494189d119f94f621131)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:00.868737 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240616a-fda4-493b-a161-7f63f0363ee0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:00.870338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 37/74] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:00 2022] GET /identity/v3/users/6869ed0ef88b494189d119f94f621131 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:00.871157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240616a-fda4-493b-a161-7f63f0363ee0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:00.956980 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:00.964960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:00.971348 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63bde1-d77a-4997-ad04-9d31072f9e35 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:00.988858 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240616a-fda4-493b-a161-7f63f0363ee0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:01.013380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c3742-1586-4cb0-a984-95e3d08cc02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:01.014007 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c3742-1586-4cb0-a984-95e3d08cc02c None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:01.014277 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c3742-1586-4cb0-a984-95e3d08cc02c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:01.014550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c3742-1586-4cb0-a984-95e3d08cc02c None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:01.015269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c3742-1586-4cb0-a984-95e3d08cc02c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:01.016901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c3742-1586-4cb0-a984-95e3d08cc02c None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:01.022016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9ace1-cdf8-4e4d-a8b6-721b80e157bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:01.022884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9ace1-cdf8-4e4d-a8b6-721b80e157bb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:01.023381 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9ace1-cdf8-4e4d-a8b6-721b80e157bb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:01.024118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9ace1-cdf8-4e4d-a8b6-721b80e157bb None admin] PATH_INFO: `/v3/users/796510ac3b2b4676b340c1699bc540e1` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:01.026426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9ace1-cdf8-4e4d-a8b6-721b80e157bb None admin] RBAC: Authorizing `identity:get_user(user_id=796510ac3b2b4676b340c1699bc540e1)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:01.028009 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9ace1-cdf8-4e4d-a8b6-721b80e157bb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:01.029992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 38/75] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:00 2022] GET /identity/v3/users/796510ac3b2b4676b340c1699bc540e1 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:01.030758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9ace1-cdf8-4e4d-a8b6-721b80e157bb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:01.092088 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 38/76] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:47:00 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:01.092912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c3742-1586-4cb0-a984-95e3d08cc02c None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:01.134694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9ace1-cdf8-4e4d-a8b6-721b80e157bb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:01.181494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe991d51-eaea-474b-95d2-c2a2a386c3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:01.182627 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe991d51-eaea-474b-95d2-c2a2a386c3fe None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:01.183112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe991d51-eaea-474b-95d2-c2a2a386c3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:01.183574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe991d51-eaea-474b-95d2-c2a2a386c3fe None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d/users/796510ac3b2b4676b340c1699bc540e1/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:01.186611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe991d51-eaea-474b-95d2-c2a2a386c3fe None admin] RBAC: Authorizing `identity:create_grant(project_id=86030394acc448f88cf92161d1688d4d, user_id=796510ac3b2b4676b340c1699bc540e1, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:01.188789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe991d51-eaea-474b-95d2-c2a2a386c3fe None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:01.219678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c3742-1586-4cb0-a984-95e3d08cc02c None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:01.263942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318e2fa-e586-4ca6-8fbf-6cbaeea9ba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:01.265653 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318e2fa-e586-4ca6-8fbf-6cbaeea9ba11 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:01.266158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318e2fa-e586-4ca6-8fbf-6cbaeea9ba11 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:01.266624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318e2fa-e586-4ca6-8fbf-6cbaeea9ba11 None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:01.268230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318e2fa-e586-4ca6-8fbf-6cbaeea9ba11 None admin] RBAC: Authorizing `identity:get_project(project_id=86030394acc448f88cf92161d1688d4d)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:01.270105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318e2fa-e586-4ca6-8fbf-6cbaeea9ba11 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:01.272394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 39/78] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:01 2022] GET /identity/v3/projects/86030394acc448f88cf92161d1688d4d => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:01.272616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 39/78] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:01 2022] PUT /identity/v3/projects/86030394acc448f88cf92161d1688d4d/users/796510ac3b2b4676b340c1699bc540e1/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:01.273765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe991d51-eaea-474b-95d2-c2a2a386c3fe None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:01.275090 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318e2fa-e586-4ca6-8fbf-6cbaeea9ba11 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:01.294780 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:01.303783 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:01.444685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe991d51-eaea-474b-95d2-c2a2a386c3fe None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:01.458545 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318e2fa-e586-4ca6-8fbf-6cbaeea9ba11 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:01.499340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc487d18-0404-4361-b94b-22730baa448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:01.499994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc487d18-0404-4361-b94b-22730baa448f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:01.500279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc487d18-0404-4361-b94b-22730baa448f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:01.500552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc487d18-0404-4361-b94b-22730baa448f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:01.515835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd94e4-442e-48ab-9926-5b9665fc2fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:01.516480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd94e4-442e-48ab-9926-5b9665fc2fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:01.516761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd94e4-442e-48ab-9926-5b9665fc2fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:01.517261 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd94e4-442e-48ab-9926-5b9665fc2fc7 None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:01.519273 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd94e4-442e-48ab-9926-5b9665fc2fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=86030394acc448f88cf92161d1688d4d)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:01.520789 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd94e4-442e-48ab-9926-5b9665fc2fc7 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:01.525310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc487d18-0404-4361-b94b-22730baa448f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:01.525513 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 40/79] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:01 2022] GET /identity/v3/projects/86030394acc448f88cf92161d1688d4d => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-fc487d18-0404-4361-b94b-22730baa448f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:01.528706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:01.529852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:01.530598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:01.530598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:01.530598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:01.530598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:01.530598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:01.530598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:01.530598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:01.530598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:01.530598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:01.530598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:01.530598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:01.530598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:01.531176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd94e4-442e-48ab-9926-5b9665fc2fc7 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:01.531243 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 40/80] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:01.538095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc487d18-0404-4361-b94b-22730baa448f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:01.674369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:01.685592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:01.707624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd94e4-442e-48ab-9926-5b9665fc2fc7 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:01.723289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc487d18-0404-4361-b94b-22730baa448f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:01.746553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fbd76-8e44-4ef6-8cd8-55203a51f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:01.748013 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fbd76-8e44-4ef6-8cd8-55203a51f329 None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:01.748013 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fbd76-8e44-4ef6-8cd8-55203a51f329 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:01.748013 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fbd76-8e44-4ef6-8cd8-55203a51f329 None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d/users/6869ed0ef88b494189d119f94f621131/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:01.749908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fbd76-8e44-4ef6-8cd8-55203a51f329 None admin] RBAC: Authorizing `identity:create_grant(project_id=86030394acc448f88cf92161d1688d4d, user_id=6869ed0ef88b494189d119f94f621131, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:01.751300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fbd76-8e44-4ef6-8cd8-55203a51f329 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:01.767598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693325a9-d001-473b-b0da-c3a42ec4f33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:01.768618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693325a9-d001-473b-b0da-c3a42ec4f33b None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:01.769103 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693325a9-d001-473b-b0da-c3a42ec4f33b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:01.769628 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693325a9-d001-473b-b0da-c3a42ec4f33b None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d/users/796510ac3b2b4676b340c1699bc540e1/roles/80aa63d20ae84a66991d542b3ed87f66` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:01.772101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693325a9-d001-473b-b0da-c3a42ec4f33b None admin] RBAC: Authorizing `identity:create_grant(project_id=86030394acc448f88cf92161d1688d4d, user_id=796510ac3b2b4676b340c1699bc540e1, role_id=80aa63d20ae84a66991d542b3ed87f66)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:01.773895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693325a9-d001-473b-b0da-c3a42ec4f33b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:01.882484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 41/81] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:01 2022] PUT /identity/v3/projects/86030394acc448f88cf92161d1688d4d/users/6869ed0ef88b494189d119f94f621131/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:01.883324 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fbd76-8e44-4ef6-8cd8-55203a51f329 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:01.929713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 41/82] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:01 2022] PUT /identity/v3/projects/86030394acc448f88cf92161d1688d4d/users/796510ac3b2b4676b340c1699bc540e1/roles/80aa63d20ae84a66991d542b3ed87f66 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:02.067920 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fbd76-8e44-4ef6-8cd8-55203a51f329 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:02.114345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ebca1-1b9c-44d7-8cbc-bc677faf711f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:02.114975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ebca1-1b9c-44d7-8cbc-bc677faf711f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:02.115256 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ebca1-1b9c-44d7-8cbc-bc677faf711f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:02.115531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ebca1-1b9c-44d7-8cbc-bc677faf711f None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:02.116213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ebca1-1b9c-44d7-8cbc-bc677faf711f None admin] RBAC: Adding query filter params (name=member) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:02.116513 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ebca1-1b9c-44d7-8cbc-bc677faf711f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:02.117978 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ebca1-1b9c-44d7-8cbc-bc677faf711f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:02.127869 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 42/83] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:02.133590 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693325a9-d001-473b-b0da-c3a42ec4f33b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:02.256230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693325a9-d001-473b-b0da-c3a42ec4f33b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:02.286079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:02.295602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9316-e560-4b8c-9af8-965feac3702b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:02.296305 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9316-e560-4b8c-9af8-965feac3702b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:02.296673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9316-e560-4b8c-9af8-965feac3702b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:02.296993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9316-e560-4b8c-9af8-965feac3702b None admin] PATH_INFO: `/v3/users/796510ac3b2b4676b340c1699bc540e1` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:02.298290 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea9316-e560-4b8c-9af8-965feac3702b None admin] RBAC: Authorizing `identity:get_user(user_id=796510ac3b2b4676b340c1699bc540e1)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:02.299744 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea9316-e560-4b8c-9af8-965feac3702b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:02.302381 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 42/84] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:02 2022] GET /identity/v3/users/796510ac3b2b4676b340c1699bc540e1 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:02.307504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ebca1-1b9c-44d7-8cbc-bc677faf711f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:02.310714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:02.426187 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ebca1-1b9c-44d7-8cbc-bc677faf711f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:02.471198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2a208-306a-42b2-a72d-4bd7e685f915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:02.471910 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2a208-306a-42b2-a72d-4bd7e685f915 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:02.472192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2a208-306a-42b2-a72d-4bd7e685f915 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:02.472523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2a208-306a-42b2-a72d-4bd7e685f915 None admin] PATH_INFO: `/v3/projects/4dbd762d41594b0bb971a86f7f31627f` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:02.474202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2a208-306a-42b2-a72d-4bd7e685f915 None admin] RBAC: Authorizing `identity:get_project(project_id=4dbd762d41594b0bb971a86f7f31627f)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:02.475714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2a208-306a-42b2-a72d-4bd7e685f915 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:02.478392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 43/85] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:02 2022] GET /identity/v3/projects/4dbd762d41594b0bb971a86f7f31627f => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:02.484436 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9316-e560-4b8c-9af8-965feac3702b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:02.600405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9316-e560-4b8c-9af8-965feac3702b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:02.636713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7135a-7306-41e1-a69c-4ec593464364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:02.637746 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7135a-7306-41e1-a69c-4ec593464364 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:02.638254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7135a-7306-41e1-a69c-4ec593464364 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:02.638725 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7135a-7306-41e1-a69c-4ec593464364 None admin] PATH_INFO: `/v3/projects/4dbd762d41594b0bb971a86f7f31627f/users/796510ac3b2b4676b340c1699bc540e1/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:02.640837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7135a-7306-41e1-a69c-4ec593464364 None admin] RBAC: Authorizing `identity:create_grant(project_id=4dbd762d41594b0bb971a86f7f31627f, user_id=796510ac3b2b4676b340c1699bc540e1, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:02.642595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7135a-7306-41e1-a69c-4ec593464364 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:02.732708 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 43/86] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:02 2022] PUT /identity/v3/projects/4dbd762d41594b0bb971a86f7f31627f/users/796510ac3b2b4676b340c1699bc540e1/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:04.166546 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d7fdd-e9eb-41a2-92a3-54dbea52ae7c None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:04.167704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d7fdd-e9eb-41a2-92a3-54dbea52ae7c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:04.168201 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d7fdd-e9eb-41a2-92a3-54dbea52ae7c None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:04.169896 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 44/87] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:04.175953 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da20711-4947-46fc-88cb-d81913e7c334 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:04.176892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da20711-4947-46fc-88cb-d81913e7c334 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:04.177413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da20711-4947-46fc-88cb-d81913e7c334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:04.197699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9da20711-4947-46fc-88cb-d81913e7c334 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:04.199256 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9da20711-4947-46fc-88cb-d81913e7c334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:04.258267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:04.280111 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 44/88] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:04.317762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f8d59-8d31-4c13-a5f7-6626aad91352 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:04.319974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f8d59-8d31-4c13-a5f7-6626aad91352 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:04.319974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f8d59-8d31-4c13-a5f7-6626aad91352 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:04.319974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 45/89] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:04.326037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cb9da-2e29-4426-812f-a67052e218f3 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:04.326321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cb9da-2e29-4426-812f-a67052e218f3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:04.326598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cb9da-2e29-4426-812f-a67052e218f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:04.354740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7f7cb9da-2e29-4426-812f-a67052e218f3 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:04.355932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7f7cb9da-2e29-4426-812f-a67052e218f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:04.443074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 45/90] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:04.601822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6176ef7-d54a-435c-a60e-4e288b1ad1e9 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:04.603097 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6176ef7-d54a-435c-a60e-4e288b1ad1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:04.603577 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6176ef7-d54a-435c-a60e-4e288b1ad1e9 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:04.605250 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 46/91] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:04.611040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b2d58-1c74-4d0c-9e15-b954e172c0eb None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:04.611608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b2d58-1c74-4d0c-9e15-b954e172c0eb None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:04.612085 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b2d58-1c74-4d0c-9e15-b954e172c0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:04.640353 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-632b2d58-1c74-4d0c-9e15-b954e172c0eb None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:04.641962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-632b2d58-1c74-4d0c-9e15-b954e172c0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:04.721597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 46/92] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:04.834625 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6176ef7-d54a-435c-a60e-4e288b1ad1e9 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:04.868733 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b2d58-1c74-4d0c-9e15-b954e172c0eb None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:04.925578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:05.029706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:05.031614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6176ef7-d54a-435c-a60e-4e288b1ad1e9 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:05.093615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a9719-47c0-4848-9abb-c4a6b95839ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:05.094246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a9719-47c0-4848-9abb-c4a6b95839ec None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:05.094525 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a9719-47c0-4848-9abb-c4a6b95839ec None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:05.094794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a9719-47c0-4848-9abb-c4a6b95839ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:05.116295 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a9719-47c0-4848-9abb-c4a6b95839ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-fb0a9719-47c0-4848-9abb-c4a6b95839ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:05.127848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:05.129071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:05.130068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:05.130068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:05.130068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:05.130068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:05.130068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:05.130068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:05.130068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:05.130068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:05.130068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:05.130068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:05.130068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:05.130068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:05.130068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 47/93] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:05.130854 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b2d58-1c74-4d0c-9e15-b954e172c0eb None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:05.136020 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a9719-47c0-4848-9abb-c4a6b95839ec None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:05.201066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b1f74-e4cc-4370-a42e-f1d1e9bf6157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:05.201746 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1f74-e4cc-4370-a42e-f1d1e9bf6157 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:05.202005 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1f74-e4cc-4370-a42e-f1d1e9bf6157 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:05.202271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1f74-e4cc-4370-a42e-f1d1e9bf6157 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:05.214803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b1f74-e4cc-4370-a42e-f1d1e9bf6157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-9f6b1f74-e4cc-4370-a42e-f1d1e9bf6157 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:05.220094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:05.220920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:05.221674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:05.221674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:05.221674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:05.221674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:05.221674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:05.221674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:05.221674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:05.221674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:05.221674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:05.221674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:05.221674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:05.221674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:05.224036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 47/94] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:47:05.225257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b1f74-e4cc-4370-a42e-f1d1e9bf6157 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:05.319071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a9719-47c0-4848-9abb-c4a6b95839ec None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:05.349973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:05.359547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2cc03-49d8-4f94-ba7f-a68d41682e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:05.359547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2cc03-49d8-4f94-ba7f-a68d41682e7b None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:05.359547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2cc03-49d8-4f94-ba7f-a68d41682e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:05.359547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2cc03-49d8-4f94-ba7f-a68d41682e7b None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:05.365043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2cc03-49d8-4f94-ba7f-a68d41682e7b None admin] RBAC: Adding query filter params (name=member) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:05.365043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2cc03-49d8-4f94-ba7f-a68d41682e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:05.365043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2cc03-49d8-4f94-ba7f-a68d41682e7b None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:05.373326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 48/95] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:05.373326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2cc03-49d8-4f94-ba7f-a68d41682e7b None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:05.386714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b1f74-e4cc-4370-a42e-f1d1e9bf6157 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:05.413714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:05.442055 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db78e84-9dfd-4679-8c48-e4257d7c3e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:05.442989 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db78e84-9dfd-4679-8c48-e4257d7c3e58 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:05.443396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db78e84-9dfd-4679-8c48-e4257d7c3e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:05.443782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db78e84-9dfd-4679-8c48-e4257d7c3e58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:05.445139 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db78e84-9dfd-4679-8c48-e4257d7c3e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:05.447200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db78e84-9dfd-4679-8c48-e4257d7c3e58 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:05.449933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 48/96] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:05.451249 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37266be8-f89b-4b8a-86ee-2c4166b9a618 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:05.451645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37266be8-f89b-4b8a-86ee-2c4166b9a618 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:05.452187 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37266be8-f89b-4b8a-86ee-2c4166b9a618 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:05.453884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 49/97] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:05.458940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37266be8-f89b-4b8a-86ee-2c4166b9a618 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:05.485726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2cc03-49d8-4f94-ba7f-a68d41682e7b None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:05.522518 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510eaeec-665c-405c-9c0e-e63a8488afcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:05.523444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eaeec-665c-405c-9c0e-e63a8488afcc None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:05.523928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eaeec-665c-405c-9c0e-e63a8488afcc None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:05.524962 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510eaeec-665c-405c-9c0e-e63a8488afcc None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:05.525916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510eaeec-665c-405c-9c0e-e63a8488afcc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:05.526647 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510eaeec-665c-405c-9c0e-e63a8488afcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:05.528777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510eaeec-665c-405c-9c0e-e63a8488afcc None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:05.541229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 49/98] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:05.542119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510eaeec-665c-405c-9c0e-e63a8488afcc None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:05.585279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37266be8-f89b-4b8a-86ee-2c4166b9a618 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:05.599933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:05.621353 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875beb6-e59e-4adc-b986-36ea5eb40e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:05.621990 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875beb6-e59e-4adc-b986-36ea5eb40e79 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:05.622275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875beb6-e59e-4adc-b986-36ea5eb40e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:05.622554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875beb6-e59e-4adc-b986-36ea5eb40e79 None admin] PATH_INFO: `/v3/users/796510ac3b2b4676b340c1699bc540e1` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:05.623807 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875beb6-e59e-4adc-b986-36ea5eb40e79 None admin] RBAC: Authorizing `identity:get_user(user_id=796510ac3b2b4676b340c1699bc540e1)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:05.625270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875beb6-e59e-4adc-b986-36ea5eb40e79 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:05.626912 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 50/99] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:05 2022] GET /identity/v3/users/796510ac3b2b4676b340c1699bc540e1 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:05.632546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bf6f0-8110-441d-8caf-ddb040e62d68 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:05.632854 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bf6f0-8110-441d-8caf-ddb040e62d68 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:05.633151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bf6f0-8110-441d-8caf-ddb040e62d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:05.647057 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510eaeec-665c-405c-9c0e-e63a8488afcc None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:05.651814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2c9bf6f0-8110-441d-8caf-ddb040e62d68 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:05.653010 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2c9bf6f0-8110-441d-8caf-ddb040e62d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:05.682745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deaa9e-feb3-4b51-9239-89b0c5e3a53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:05.683362 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deaa9e-feb3-4b51-9239-89b0c5e3a53e None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:05.683643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deaa9e-feb3-4b51-9239-89b0c5e3a53e None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:05.683925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deaa9e-feb3-4b51-9239-89b0c5e3a53e None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:05.684608 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deaa9e-feb3-4b51-9239-89b0c5e3a53e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:05.686100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deaa9e-feb3-4b51-9239-89b0c5e3a53e None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:05.692601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:05.725127 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 51/100] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:05.726596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06b822-a955-4f4a-8c7f-e439ccedbcb4 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:05.726878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06b822-a955-4f4a-8c7f-e439ccedbcb4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:05.727158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06b822-a955-4f4a-8c7f-e439ccedbcb4 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:05.728648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 52/101] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:05.730148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06b822-a955-4f4a-8c7f-e439ccedbcb4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:05.840620 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06b822-a955-4f4a-8c7f-e439ccedbcb4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:05.874471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0746ee-492d-4c71-9cd6-cf98b17fdf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:05.875098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0746ee-492d-4c71-9cd6-cf98b17fdf45 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:05.875380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0746ee-492d-4c71-9cd6-cf98b17fdf45 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:05.875652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0746ee-492d-4c71-9cd6-cf98b17fdf45 None admin] PATH_INFO: `/v3/users/6d4aaf9894b949cba6ce3c89251b384c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:05.886604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 50/102] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:47:05 2022] POST /identity/v3/projects => generated 302 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:05.892306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deaa9e-feb3-4b51-9239-89b0c5e3a53e None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:05.895146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0746ee-492d-4c71-9cd6-cf98b17fdf45 None admin] RBAC: Authorizing `identity:get_user(user_id=6d4aaf9894b949cba6ce3c89251b384c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:05.896752 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0746ee-492d-4c71-9cd6-cf98b17fdf45 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:05.898736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 53/103] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:05 2022] GET /identity/v3/users/6d4aaf9894b949cba6ce3c89251b384c => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:05.899978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583751f-222e-4b6e-9273-2920914ef997 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:05.900366 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583751f-222e-4b6e-9273-2920914ef997 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:05.900645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583751f-222e-4b6e-9273-2920914ef997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:05.922876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c583751f-222e-4b6e-9273-2920914ef997 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:05.924377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c583751f-222e-4b6e-9273-2920914ef997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:05.986450 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:06.047903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 54/104] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:06.048800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583751f-222e-4b6e-9273-2920914ef997 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:06.085863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deaa9e-feb3-4b51-9239-89b0c5e3a53e None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:06.095811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:06.132671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b85c3-823b-46a4-916c-af7ffb0581c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:06.133634 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b85c3-823b-46a4-916c-af7ffb0581c1 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:06.134996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b85c3-823b-46a4-916c-af7ffb0581c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:06.135290 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b85c3-823b-46a4-916c-af7ffb0581c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:06.188707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583751f-222e-4b6e-9273-2920914ef997 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:06.225497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b85c3-823b-46a4-916c-af7ffb0581c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:06.226981 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b85c3-823b-46a4-916c-af7ffb0581c1 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:06.231660 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ab694-93cc-440a-a4a5-c6f35d836dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:06.232839 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ab694-93cc-440a-a4a5-c6f35d836dff None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:06.233271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ab694-93cc-440a-a4a5-c6f35d836dff None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:06.233726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ab694-93cc-440a-a4a5-c6f35d836dff None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:06.235223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ab694-93cc-440a-a4a5-c6f35d836dff None admin] RBAC: Authorizing `identity:get_project(project_id=86030394acc448f88cf92161d1688d4d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:06.236813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ab694-93cc-440a-a4a5-c6f35d836dff None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:06.238954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 55/105] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:06 2022] GET /identity/v3/projects/86030394acc448f88cf92161d1688d4d => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:06.239853 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ab694-93cc-440a-a4a5-c6f35d836dff None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:06.269888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:06.347285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 51/106] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:06.349214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50d382-00dc-4c41-8a67-f5046c9ed592 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:06.349656 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50d382-00dc-4c41-8a67-f5046c9ed592 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:06.350070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50d382-00dc-4c41-8a67-f5046c9ed592 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:06.351478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 52/107] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:06.352292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50d382-00dc-4c41-8a67-f5046c9ed592 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:06.361970 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:06.373852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ab694-93cc-440a-a4a5-c6f35d836dff None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:06.412729 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53490857-d6ca-480e-81c6-e195152b5fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:06.413398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53490857-d6ca-480e-81c6-e195152b5fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:06.413936 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53490857-d6ca-480e-81c6-e195152b5fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:06.414219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53490857-d6ca-480e-81c6-e195152b5fc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:06.426634 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53490857-d6ca-480e-81c6-e195152b5fc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-53490857-d6ca-480e-81c6-e195152b5fc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:06.432194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:06.433022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:06.433948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:06.433948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:06.433948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:06.433948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:06.433948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:06.433948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:06.433948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:06.433948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:06.433948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:06.433948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:06.433948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:47:06.433948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:06.433948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 56/108] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:47:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:06.435019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53490857-d6ca-480e-81c6-e195152b5fc2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:06.461223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50d382-00dc-4c41-8a67-f5046c9ed592 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:06.499096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2318fb-4c30-45be-bead-7c58c42c0e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:06.500046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2318fb-4c30-45be-bead-7c58c42c0e6b None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:06.500520 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2318fb-4c30-45be-bead-7c58c42c0e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:06.500793 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2318fb-4c30-45be-bead-7c58c42c0e6b None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d/users/6d4aaf9894b949cba6ce3c89251b384c/roles/2e8a422395c1407e9f923b187fe96450` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:06.502757 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2318fb-4c30-45be-bead-7c58c42c0e6b None admin] RBAC: Authorizing `identity:create_grant(project_id=86030394acc448f88cf92161d1688d4d, user_id=6d4aaf9894b949cba6ce3c89251b384c, role_id=2e8a422395c1407e9f923b187fe96450)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:06.504241 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2318fb-4c30-45be-bead-7c58c42c0e6b None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:06.528314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:06.540776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53490857-d6ca-480e-81c6-e195152b5fc2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:06.575115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0da34-1014-40c2-ba76-2e78aff62a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:06.575740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0da34-1014-40c2-ba76-2e78aff62a30 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:06.576019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0da34-1014-40c2-ba76-2e78aff62a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:06.576292 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0da34-1014-40c2-ba76-2e78aff62a30 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:06.585351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 53/109] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:06 2022] PUT /identity/v3/projects/86030394acc448f88cf92161d1688d4d/users/6d4aaf9894b949cba6ce3c89251b384c/roles/2e8a422395c1407e9f923b187fe96450 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:06.586838 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d950d-3d0c-4a74-b015-c85d4bc6fd7d None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:06.587268 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d950d-3d0c-4a74-b015-c85d4bc6fd7d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:06.587673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d950d-3d0c-4a74-b015-c85d4bc6fd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:06.594904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0da34-1014-40c2-ba76-2e78aff62a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-e6a0da34-1014-40c2-ba76-2e78aff62a30 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:06.600462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:06.601848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 57/110] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:47:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:06.602866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0da34-1014-40c2-ba76-2e78aff62a30 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:06.617352 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-6e4d950d-3d0c-4a74-b015-c85d4bc6fd7d None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:06.617352 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6e4d950d-3d0c-4a74-b015-c85d4bc6fd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:06.687897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:06.696951 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 54/111] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:06.698086 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d950d-3d0c-4a74-b015-c85d4bc6fd7d None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:06.774032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0da34-1014-40c2-ba76-2e78aff62a30 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:06.827893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276c5a3-7b2d-43b4-b7d4-54eb05b796a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:06.828540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c5a3-7b2d-43b4-b7d4-54eb05b796a6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:06.828821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c5a3-7b2d-43b4-b7d4-54eb05b796a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:06.829099 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c5a3-7b2d-43b4-b7d4-54eb05b796a6 None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:06.830528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276c5a3-7b2d-43b4-b7d4-54eb05b796a6 None admin] RBAC: Authorizing `identity:get_project(project_id=86030394acc448f88cf92161d1688d4d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:06.832080 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276c5a3-7b2d-43b4-b7d4-54eb05b796a6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:06.834759 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 58/112] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:06 2022] GET /identity/v3/projects/86030394acc448f88cf92161d1688d4d => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:06.835314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276c5a3-7b2d-43b4-b7d4-54eb05b796a6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:06.840021 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d950d-3d0c-4a74-b015-c85d4bc6fd7d None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:06.861238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:06.885460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf2dfb-5185-4d7b-86b9-fd8f98f6da67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:06.886078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf2dfb-5185-4d7b-86b9-fd8f98f6da67 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:06.886354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf2dfb-5185-4d7b-86b9-fd8f98f6da67 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:06.886624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf2dfb-5185-4d7b-86b9-fd8f98f6da67 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:06.887292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf2dfb-5185-4d7b-86b9-fd8f98f6da67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:06.888035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf2dfb-5185-4d7b-86b9-fd8f98f6da67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:06.889801 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf2dfb-5185-4d7b-86b9-fd8f98f6da67 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:06.905503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 55/113] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:06.906426 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf2dfb-5185-4d7b-86b9-fd8f98f6da67 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:06.986565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276c5a3-7b2d-43b4-b7d4-54eb05b796a6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:07.007506 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:07.034466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1624a-5728-4d8a-abac-923ce545b51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:07.035520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1624a-5728-4d8a-abac-923ce545b51d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:07.035807 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1624a-5728-4d8a-abac-923ce545b51d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:07.036081 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1624a-5728-4d8a-abac-923ce545b51d None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:07.037161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1624a-5728-4d8a-abac-923ce545b51d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:07.037498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1624a-5728-4d8a-abac-923ce545b51d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:07.039229 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1624a-5728-4d8a-abac-923ce545b51d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:07.049598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 59/114] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:07.050742 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1624a-5728-4d8a-abac-923ce545b51d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:07.064170 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf2dfb-5185-4d7b-86b9-fd8f98f6da67 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:07.101200 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d387154-a20d-4748-87d9-40f0cabb8103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:07.101835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d387154-a20d-4748-87d9-40f0cabb8103 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:07.102112 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d387154-a20d-4748-87d9-40f0cabb8103 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:07.102383 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d387154-a20d-4748-87d9-40f0cabb8103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:07.103133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d387154-a20d-4748-87d9-40f0cabb8103 None admin] RBAC: Adding query filter params (role.id=c3f5b94962604da78f8e1a5d18105768, scope.project.id=86030394acc448f88cf92161d1688d4d, user.id=796510ac3b2b4676b340c1699bc540e1) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:07.103433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d387154-a20d-4748-87d9-40f0cabb8103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:07.105441 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d387154-a20d-4748-87d9-40f0cabb8103 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:07.112735 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 56/115] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:47:06 2022] GET /identity/v3/role_assignments?user.id=796510ac3b2b4676b340c1699bc540e1&scope.project.id=86030394acc448f88cf92161d1688d4d&role.id=c3f5b94962604da78f8e1a5d18105768 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:07.114180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d387154-a20d-4748-87d9-40f0cabb8103 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:07.184744 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:07.237593 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1624a-5728-4d8a-abac-923ce545b51d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:07.267699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d387154-a20d-4748-87d9-40f0cabb8103 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:07.296080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:07.322604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1526b66-438a-4222-9d0b-341a26196c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:07.322604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1526b66-438a-4222-9d0b-341a26196c7e None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:07.322604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1526b66-438a-4222-9d0b-341a26196c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:07.322959 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1526b66-438a-4222-9d0b-341a26196c7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:07.330694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12e585-f88d-4895-9b0c-14803acbc693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:07.331656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12e585-f88d-4895-9b0c-14803acbc693 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:07.332139 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12e585-f88d-4895-9b0c-14803acbc693 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:07.332602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12e585-f88d-4895-9b0c-14803acbc693 None admin] PATH_INFO: `/v3/users/6869ed0ef88b494189d119f94f621131` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:07.334027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12e585-f88d-4895-9b0c-14803acbc693 None admin] RBAC: Authorizing `identity:get_user(user_id=6869ed0ef88b494189d119f94f621131)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:07.335682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12e585-f88d-4895-9b0c-14803acbc693 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:07.338172 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 60/116] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:07 2022] GET /identity/v3/users/6869ed0ef88b494189d119f94f621131 => generated 247 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:07.339263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12e585-f88d-4895-9b0c-14803acbc693 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:07.341716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1526b66-438a-4222-9d0b-341a26196c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-a1526b66-438a-4222-9d0b-341a26196c7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:07.349089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:07.350460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:07.351180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:07.351180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:07.351180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:07.351180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:07.351180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:07.351180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:07.351180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:07.351180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:07.351180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:07.351180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:07.351180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:07.351180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:07.357144 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 57/117] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:07.357144 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1526b66-438a-4222-9d0b-341a26196c7e None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:07.467259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12e585-f88d-4895-9b0c-14803acbc693 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:07.481025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1526b66-438a-4222-9d0b-341a26196c7e None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:07.510599 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea552025-672e-40e9-a66d-35b60ab48d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:07.512190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea552025-672e-40e9-a66d-35b60ab48d27 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:07.512645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea552025-672e-40e9-a66d-35b60ab48d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:07.513083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea552025-672e-40e9-a66d-35b60ab48d27 None admin] PATH_INFO: `/v3/users/796510ac3b2b4676b340c1699bc540e1` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:07.514624 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea552025-672e-40e9-a66d-35b60ab48d27 None admin] RBAC: Authorizing `identity:get_user(user_id=796510ac3b2b4676b340c1699bc540e1)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:07.516269 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea552025-672e-40e9-a66d-35b60ab48d27 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:07.521389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e6849-ce2e-4489-ab03-82f992acdc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:07.521389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e6849-ce2e-4489-ab03-82f992acdc9f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:07.521389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e6849-ce2e-4489-ab03-82f992acdc9f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:07.521389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e6849-ce2e-4489-ab03-82f992acdc9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:07.521816 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 61/118] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:07 2022] GET /identity/v3/users/796510ac3b2b4676b340c1699bc540e1 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:07.522784 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea552025-672e-40e9-a66d-35b60ab48d27 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:07.546761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:07.580116 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:07.600631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e6849-ce2e-4489-ab03-82f992acdc9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:07.602184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e6849-ce2e-4489-ab03-82f992acdc9f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:07.645908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea552025-672e-40e9-a66d-35b60ab48d27 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:07.688838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e81d62-a0a9-4095-9c2a-3ea27d999ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:07.688838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e81d62-a0a9-4095-9c2a-3ea27d999ffc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:07.688838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e81d62-a0a9-4095-9c2a-3ea27d999ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:07.688838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e81d62-a0a9-4095-9c2a-3ea27d999ffc None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:07.689280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e81d62-a0a9-4095-9c2a-3ea27d999ffc None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:07.689280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e81d62-a0a9-4095-9c2a-3ea27d999ffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:07.689434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e81d62-a0a9-4095-9c2a-3ea27d999ffc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:07.700331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 62/119] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:07.700934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e81d62-a0a9-4095-9c2a-3ea27d999ffc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:07.722096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 58/120] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:07.723356 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e6849-ce2e-4489-ab03-82f992acdc9f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:07.794966 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:07.822604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e81d62-a0a9-4095-9c2a-3ea27d999ffc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:07.827127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:07.846260 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e6849-ce2e-4489-ab03-82f992acdc9f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:07.866804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399f887-f320-47e9-9550-458ab7c90bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:07.867677 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399f887-f320-47e9-9550-458ab7c90bac None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:07.869069 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399f887-f320-47e9-9550-458ab7c90bac None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:07.869552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399f887-f320-47e9-9550-458ab7c90bac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:07.883868 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4491db5-9373-4d8d-b11e-2edb98efa1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:07.884711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4491db5-9373-4d8d-b11e-2edb98efa1eb None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:07.884994 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4491db5-9373-4d8d-b11e-2edb98efa1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:07.885271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4491db5-9373-4d8d-b11e-2edb98efa1eb None admin] PATH_INFO: `/v3/users/796510ac3b2b4676b340c1699bc540e1` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:07.886565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4491db5-9373-4d8d-b11e-2edb98efa1eb None admin] RBAC: Authorizing `identity:get_user(user_id=796510ac3b2b4676b340c1699bc540e1)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:07.888088 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4491db5-9373-4d8d-b11e-2edb98efa1eb None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:07.894328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 59/121] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:07 2022] GET /identity/v3/users/796510ac3b2b4676b340c1699bc540e1 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:07.894328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4491db5-9373-4d8d-b11e-2edb98efa1eb None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:07.965381 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399f887-f320-47e9-9550-458ab7c90bac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:07.967966 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399f887-f320-47e9-9550-458ab7c90bac None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:08.014000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4491db5-9373-4d8d-b11e-2edb98efa1eb None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:08.051481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a226b-011a-4214-b356-167701225b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:08.052417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a226b-011a-4214-b356-167701225b02 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:08.052765 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a226b-011a-4214-b356-167701225b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:08.053151 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a226b-011a-4214-b356-167701225b02 None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:08.054464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a226b-011a-4214-b356-167701225b02 None admin] RBAC: Authorizing `identity:get_project(project_id=86030394acc448f88cf92161d1688d4d)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:08.056684 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a226b-011a-4214-b356-167701225b02 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:08.058734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 60/122] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:07 2022] GET /identity/v3/projects/86030394acc448f88cf92161d1688d4d => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:08.064205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a226b-011a-4214-b356-167701225b02 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:08.067620 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:08.088071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:08.105789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 63/123] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:08.108242 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399f887-f320-47e9-9550-458ab7c90bac None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:08.178190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a226b-011a-4214-b356-167701225b02 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:08.215649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace51a9b-5f98-4f1a-b464-9c8a8b608d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:08.216426 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace51a9b-5f98-4f1a-b464-9c8a8b608d08 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:08.216650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace51a9b-5f98-4f1a-b464-9c8a8b608d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:08.216928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace51a9b-5f98-4f1a-b464-9c8a8b608d08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:08.244190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399f887-f320-47e9-9550-458ab7c90bac None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:08.289825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14667cb-5b16-470e-947e-35f3a905d77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:08.291975 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14667cb-5b16-470e-947e-35f3a905d77a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:08.292437 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14667cb-5b16-470e-947e-35f3a905d77a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:08.293136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14667cb-5b16-470e-947e-35f3a905d77a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:08.294071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace51a9b-5f98-4f1a-b464-9c8a8b608d08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:08.294323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14667cb-5b16-470e-947e-35f3a905d77a None admin] RBAC: Adding query filter params (role.id=c62ffefc63e74a1280bef2b6a22202ad, scope.project.id=86030394acc448f88cf92161d1688d4d, user.id=6869ed0ef88b494189d119f94f621131) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:08.294801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14667cb-5b16-470e-947e-35f3a905d77a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:08.296048 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace51a9b-5f98-4f1a-b464-9c8a8b608d08 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:08.296597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14667cb-5b16-470e-947e-35f3a905d77a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:08.309058 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 64/124] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:47:08 2022] GET /identity/v3/role_assignments?user.id=6869ed0ef88b494189d119f94f621131&scope.project.id=86030394acc448f88cf92161d1688d4d&role.id=c62ffefc63e74a1280bef2b6a22202ad => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:08.310286 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14667cb-5b16-470e-947e-35f3a905d77a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:08.334464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:08.435351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 61/125] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:08.442938 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace51a9b-5f98-4f1a-b464-9c8a8b608d08 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:08.455701 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:08.528396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14667cb-5b16-470e-947e-35f3a905d77a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:08.570256 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a2374-fb9b-42a3-8d0e-de0373bb6405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:08.571621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2374-fb9b-42a3-8d0e-de0373bb6405 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:08.572162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2374-fb9b-42a3-8d0e-de0373bb6405 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:08.572574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a2374-fb9b-42a3-8d0e-de0373bb6405 None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:08.574024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a2374-fb9b-42a3-8d0e-de0373bb6405 None admin] RBAC: Authorizing `identity:get_project(project_id=86030394acc448f88cf92161d1688d4d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:08.575549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a2374-fb9b-42a3-8d0e-de0373bb6405 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:08.577369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 65/126] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:08 2022] GET /identity/v3/projects/86030394acc448f88cf92161d1688d4d => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:08.578730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace51a9b-5f98-4f1a-b464-9c8a8b608d08 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:08.579468 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c5749-1a1f-455c-b474-62925e83f494 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:08.579750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c5749-1a1f-455c-b474-62925e83f494 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:08.580017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c5749-1a1f-455c-b474-62925e83f494 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:08.581224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 66/127] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:08.586264 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c5749-1a1f-455c-b474-62925e83f494 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:08.599775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:08.619304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffa478-e9ef-4e14-8432-2a1d0c37a4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:08.620065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffa478-e9ef-4e14-8432-2a1d0c37a4ed None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:08.620340 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffa478-e9ef-4e14-8432-2a1d0c37a4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:08.624476 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffa478-e9ef-4e14-8432-2a1d0c37a4ed None admin] PATH_INFO: `/v3/projects/4dbd762d41594b0bb971a86f7f31627f` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:08.624476 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffa478-e9ef-4e14-8432-2a1d0c37a4ed None admin] RBAC: Authorizing `identity:get_project(project_id=4dbd762d41594b0bb971a86f7f31627f)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:08.624476 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffa478-e9ef-4e14-8432-2a1d0c37a4ed None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:08.625155 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 62/128] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:08 2022] GET /identity/v3/projects/4dbd762d41594b0bb971a86f7f31627f => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:08.626633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa5d43-9550-4277-b77f-3e5786ed408a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:08.626633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa5d43-9550-4277-b77f-3e5786ed408a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:08.626921 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa5d43-9550-4277-b77f-3e5786ed408a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:08.647758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-63fa5d43-9550-4277-b77f-3e5786ed408a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:08.648956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-63fa5d43-9550-4277-b77f-3e5786ed408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:08.700450 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c5749-1a1f-455c-b474-62925e83f494 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:08.709674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:08.727271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 63/129] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:08.727271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa5d43-9550-4277-b77f-3e5786ed408a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:08.749055 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a2383-0c93-4391-b189-5ddf5f4fbca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:08.749779 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a2383-0c93-4391-b189-5ddf5f4fbca5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:08.750129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a2383-0c93-4391-b189-5ddf5f4fbca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:08.750470 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a2383-0c93-4391-b189-5ddf5f4fbca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:08.751252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a2383-0c93-4391-b189-5ddf5f4fbca5 None admin] RBAC: Adding query filter params (role.id=80aa63d20ae84a66991d542b3ed87f66, scope.project.id=86030394acc448f88cf92161d1688d4d, user.id=796510ac3b2b4676b340c1699bc540e1) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:08.751624 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a2383-0c93-4391-b189-5ddf5f4fbca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:08.753119 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a2383-0c93-4391-b189-5ddf5f4fbca5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:08.765328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 67/130] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:47:08 2022] GET /identity/v3/role_assignments?user.id=796510ac3b2b4676b340c1699bc540e1&scope.project.id=86030394acc448f88cf92161d1688d4d&role.id=80aa63d20ae84a66991d542b3ed87f66 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:08.859023 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa5d43-9550-4277-b77f-3e5786ed408a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:08.878028 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:08.897435 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aebcf3-759c-41d6-ad98-2b487e83c044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:08.898066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aebcf3-759c-41d6-ad98-2b487e83c044 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:08.898345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aebcf3-759c-41d6-ad98-2b487e83c044 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:08.898878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aebcf3-759c-41d6-ad98-2b487e83c044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:08.899885 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aebcf3-759c-41d6-ad98-2b487e83c044 None admin] RBAC: Adding query filter params (role.id=c3f5b94962604da78f8e1a5d18105768, scope.project.id=4dbd762d41594b0bb971a86f7f31627f, user.id=796510ac3b2b4676b340c1699bc540e1) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:08.900185 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aebcf3-759c-41d6-ad98-2b487e83c044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:08.901778 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aebcf3-759c-41d6-ad98-2b487e83c044 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:08.908939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 64/131] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:47:08 2022] GET /identity/v3/role_assignments?user.id=796510ac3b2b4676b340c1699bc540e1&scope.project.id=4dbd762d41594b0bb971a86f7f31627f&role.id=c3f5b94962604da78f8e1a5d18105768 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:09.027341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a2383-0c93-4391-b189-5ddf5f4fbca5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:09.071769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ea4e1-b475-4d50-97d0-dd2eb89543cd None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:09.072107 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ea4e1-b475-4d50-97d0-dd2eb89543cd None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:09.072398 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ea4e1-b475-4d50-97d0-dd2eb89543cd None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:09.074027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 65/132] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:47:09.079561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacc3f8-7931-4090-b739-4157c9ef6ebc None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:09.079865 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacc3f8-7931-4090-b739-4157c9ef6ebc None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:09.080122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacc3f8-7931-4090-b739-4157c9ef6ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:09.098937 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-faacc3f8-7931-4090-b739-4157c9ef6ebc None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:09.100135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-faacc3f8-7931-4090-b739-4157c9ef6ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:09.149366 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a2383-0c93-4391-b189-5ddf5f4fbca5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:09.178029 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 66/133] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:09.184076 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e23f85-6d76-4b27-825b-b7addfc7a9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:09.184689 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e23f85-6d76-4b27-825b-b7addfc7a9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:09.184973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e23f85-6d76-4b27-825b-b7addfc7a9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:09.185250 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e23f85-6d76-4b27-825b-b7addfc7a9f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:09.186380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e23f85-6d76-4b27-825b-b7addfc7a9f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:09.187820 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e23f85-6d76-4b27-825b-b7addfc7a9f9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:09.189431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 68/134] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:09.194779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacc3f8-7931-4090-b739-4157c9ef6ebc None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:09.293431 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacc3f8-7931-4090-b739-4157c9ef6ebc None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:09.304319 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:09.327042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3eb2a-7d19-4472-a454-65ee99891062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:09.327641 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3eb2a-7d19-4472-a454-65ee99891062 None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:09.327916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3eb2a-7d19-4472-a454-65ee99891062 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:09.328183 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3eb2a-7d19-4472-a454-65ee99891062 None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:09.328829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3eb2a-7d19-4472-a454-65ee99891062 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:09.330302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3eb2a-7d19-4472-a454-65ee99891062 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:09.434650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 67/135] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:47:09 2022] POST /identity/v3/users => generated 283 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:09.449768 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e23f85-6d76-4b27-825b-b7addfc7a9f9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:09.495956 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:09.558342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e23f85-6d76-4b27-825b-b7addfc7a9f9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:09.595774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb8c10-d869-4ae6-a5c5-76ca5707390e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:09.596409 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb8c10-d869-4ae6-a5c5-76ca5707390e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:09.596687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb8c10-d869-4ae6-a5c5-76ca5707390e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:09.596956 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb8c10-d869-4ae6-a5c5-76ca5707390e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:09.607936 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb8c10-d869-4ae6-a5c5-76ca5707390e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2afb8c10-d869-4ae6-a5c5-76ca5707390e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:09.613190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:09.614073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:09.614859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:09.614859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:09.614859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:09.614859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:09.614859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:09.614859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:09.614859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:09.614859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:09.614859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:09.614859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:09.614859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:09.614859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:09.614859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 69/136] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:09.620775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3eb2a-7d19-4472-a454-65ee99891062 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:09.723886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3eb2a-7d19-4472-a454-65ee99891062 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:09.761309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43af56-e4c8-4dd8-a988-83e4f2f0971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:09.762091 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43af56-e4c8-4dd8-a988-83e4f2f0971f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:09.762491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43af56-e4c8-4dd8-a988-83e4f2f0971f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:09.762869 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43af56-e4c8-4dd8-a988-83e4f2f0971f None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:09.763648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43af56-e4c8-4dd8-a988-83e4f2f0971f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:09.763957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43af56-e4c8-4dd8-a988-83e4f2f0971f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:09.765427 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43af56-e4c8-4dd8-a988-83e4f2f0971f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:09.774364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 68/137] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:09.780195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb8c10-d869-4ae6-a5c5-76ca5707390e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:09.894469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:09.897599 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb8c10-d869-4ae6-a5c5-76ca5707390e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:09.932701 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8aea5-145e-40a8-80ac-ae3fdb9670da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:09.933564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8aea5-145e-40a8-80ac-ae3fdb9670da None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:09.933943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8aea5-145e-40a8-80ac-ae3fdb9670da None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:09.934326 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8aea5-145e-40a8-80ac-ae3fdb9670da None admin] PATH_INFO: `/v3/users/6d4aaf9894b949cba6ce3c89251b384c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:09.935878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8aea5-145e-40a8-80ac-ae3fdb9670da None admin] RBAC: Authorizing `identity:get_user(user_id=6d4aaf9894b949cba6ce3c89251b384c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:09.937497 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8aea5-145e-40a8-80ac-ae3fdb9670da None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:09.939422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 70/138] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:09 2022] GET /identity/v3/users/6d4aaf9894b949cba6ce3c89251b384c => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:09.949627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43af56-e4c8-4dd8-a988-83e4f2f0971f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:09.984575 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:10.061563 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43af56-e4c8-4dd8-a988-83e4f2f0971f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:10.096829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c2a1e-d7e2-422a-8371-bd94f79bc6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:10.097494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c2a1e-d7e2-422a-8371-bd94f79bc6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:10.098016 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c2a1e-d7e2-422a-8371-bd94f79bc6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:10.098341 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c2a1e-d7e2-422a-8371-bd94f79bc6e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:10.169576 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c2a1e-d7e2-422a-8371-bd94f79bc6e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:10.170951 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c2a1e-d7e2-422a-8371-bd94f79bc6e6 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:10.199267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:10.273966 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 69/139] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:10.280530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8aea5-145e-40a8-80ac-ae3fdb9670da None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:10.382915 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8aea5-145e-40a8-80ac-ae3fdb9670da None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:10.418540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852915a7-5622-4674-9e9b-5a8eb240f28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:10.419170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852915a7-5622-4674-9e9b-5a8eb240f28e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:10.419447 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852915a7-5622-4674-9e9b-5a8eb240f28e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:10.419774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852915a7-5622-4674-9e9b-5a8eb240f28e None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:10.420848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852915a7-5622-4674-9e9b-5a8eb240f28e None admin] RBAC: Authorizing `identity:get_project(project_id=86030394acc448f88cf92161d1688d4d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:10.422322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852915a7-5622-4674-9e9b-5a8eb240f28e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:10.423931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 71/140] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:10 2022] GET /identity/v3/projects/86030394acc448f88cf92161d1688d4d => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:10.429848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c2a1e-d7e2-422a-8371-bd94f79bc6e6 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:10.539294 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c2a1e-d7e2-422a-8371-bd94f79bc6e6 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:10.569520 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:10.575089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d4144-b783-49ea-b408-8e391b6e4faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:10.575699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d4144-b783-49ea-b408-8e391b6e4faf None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:10.575978 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d4144-b783-49ea-b408-8e391b6e4faf None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:10.576245 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d4144-b783-49ea-b408-8e391b6e4faf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:10.576965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d4144-b783-49ea-b408-8e391b6e4faf None admin] RBAC: Adding query filter params (role.id=2e8a422395c1407e9f923b187fe96450, scope.project.id=86030394acc448f88cf92161d1688d4d, user.id=6d4aaf9894b949cba6ce3c89251b384c) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:10.577265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d4144-b783-49ea-b408-8e391b6e4faf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:10.578719 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d4144-b783-49ea-b408-8e391b6e4faf None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:10.584638 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 70/141] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:47:10 2022] GET /identity/v3/role_assignments?user.id=6d4aaf9894b949cba6ce3c89251b384c&scope.project.id=86030394acc448f88cf92161d1688d4d&role.id=2e8a422395c1407e9f923b187fe96450 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:11.740842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27da48-bf76-454e-83bf-5bbf873c4ae3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:11.741577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27da48-bf76-454e-83bf-5bbf873c4ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:11.741577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27da48-bf76-454e-83bf-5bbf873c4ae3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:11.743654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 72/142] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:11.748546 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c6a67-dc51-4604-bfe1-e5972f98d553 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:11.748961 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c6a67-dc51-4604-bfe1-e5972f98d553 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:11.749121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c6a67-dc51-4604-bfe1-e5972f98d553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:11.767525 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-3d9c6a67-dc51-4604-bfe1-e5972f98d553 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:11.768697 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3d9c6a67-dc51-4604-bfe1-e5972f98d553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:11.843997 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 71/143] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:11.916951 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8a985-23ff-41ca-9ce6-7863bcf875fa None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:11.917272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8a985-23ff-41ca-9ce6-7863bcf875fa None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:11.917527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8a985-23ff-41ca-9ce6-7863bcf875fa None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:11.919017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 73/144] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:11.923967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910be63-aa9f-4458-ab58-72d8df9e2cf5 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:11.924254 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910be63-aa9f-4458-ab58-72d8df9e2cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:11.924524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910be63-aa9f-4458-ab58-72d8df9e2cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:11.944990 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-6910be63-aa9f-4458-ab58-72d8df9e2cf5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:11.946524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6910be63-aa9f-4458-ab58-72d8df9e2cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:12.025326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 72/145] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:12.066022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dee44-8ded-4078-bb82-8ea42d362106 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:12.066315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dee44-8ded-4078-bb82-8ea42d362106 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:12.066582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46dee44-8ded-4078-bb82-8ea42d362106 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:12.068047 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 74/146] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:12.074055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791432b-2f4e-407c-9098-440c248bae82 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:12.074340 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791432b-2f4e-407c-9098-440c248bae82 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:12.074610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791432b-2f4e-407c-9098-440c248bae82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:12.092933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f791432b-2f4e-407c-9098-440c248bae82 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:12.094139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f791432b-2f4e-407c-9098-440c248bae82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:12.113054 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dee44-8ded-4078-bb82-8ea42d362106 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:12.141718 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:12.150489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:12.162384 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 73/147] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:12.214007 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46dee44-8ded-4078-bb82-8ea42d362106 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:12.249475 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde20ad-133c-4494-9b81-cded34f9982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:12.250091 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde20ad-133c-4494-9b81-cded34f9982e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:12.250366 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde20ad-133c-4494-9b81-cded34f9982e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:12.250631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde20ad-133c-4494-9b81-cded34f9982e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:12.261059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde20ad-133c-4494-9b81-cded34f9982e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-cfde20ad-133c-4494-9b81-cded34f9982e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:12.265884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:12.266786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:12.267550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:12.267550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:12.267550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:12.267550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:12.267550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:12.267550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:12.267550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:12.267550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:12.267550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:12.267550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:12.267550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:47:12.267550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:12.267550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 75/148] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:47:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:47:12.274207 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791432b-2f4e-407c-9098-440c248bae82 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:12.312572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde20ad-133c-4494-9b81-cded34f9982e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:12.378966 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791432b-2f4e-407c-9098-440c248bae82 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:12.414332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:12.414615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa4990-8092-4a2c-9101-b23e142fa3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:12.415239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa4990-8092-4a2c-9101-b23e142fa3ca None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:12.415512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa4990-8092-4a2c-9101-b23e142fa3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:12.415780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa4990-8092-4a2c-9101-b23e142fa3ca None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:12.416468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa4990-8092-4a2c-9101-b23e142fa3ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:12.416762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa4990-8092-4a2c-9101-b23e142fa3ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:12.418226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa4990-8092-4a2c-9101-b23e142fa3ca None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:12.421903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde20ad-133c-4494-9b81-cded34f9982e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:12.426533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 74/149] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:12.432528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa4990-8092-4a2c-9101-b23e142fa3ca None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:12.458655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc58c3-a262-4a2c-b000-45aab8770bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:12.459274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc58c3-a262-4a2c-b000-45aab8770bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:12.459547 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc58c3-a262-4a2c-b000-45aab8770bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:12.459824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc58c3-a262-4a2c-b000-45aab8770bf3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:12.470213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc58c3-a262-4a2c-b000-45aab8770bf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f0bc58c3-a262-4a2c-b000-45aab8770bf3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:12.475430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:12.476514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:12.477869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:12.477869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:12.477869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:12.477869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:12.477869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:12.477869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:12.477869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:12.477869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:12.477869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:12.477869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:12.477869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:12.477869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:12.477869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 76/150] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:47:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:47:12.479462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc58c3-a262-4a2c-b000-45aab8770bf3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:12.479989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:12.535300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa4990-8092-4a2c-9101-b23e142fa3ca None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:12.569003 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb2166-4636-4500-a37b-fec844c53cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:12.569660 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb2166-4636-4500-a37b-fec844c53cca None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:12.569936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb2166-4636-4500-a37b-fec844c53cca None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:12.570209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb2166-4636-4500-a37b-fec844c53cca None admin] PATH_INFO: `/v3/users/dfb342ff3fec4b8498d738dfc4f656a3` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:12.575927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc58c3-a262-4a2c-b000-45aab8770bf3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:12.583193 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb2166-4636-4500-a37b-fec844c53cca None admin] RBAC: Authorizing `identity:get_user(user_id=dfb342ff3fec4b8498d738dfc4f656a3)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:12.584643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb2166-4636-4500-a37b-fec844c53cca None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:12.586264 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 75/151] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:12 2022] GET /identity/v3/users/dfb342ff3fec4b8498d738dfc4f656a3 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:12.587615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb2166-4636-4500-a37b-fec844c53cca None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:12.611444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca9791-a085-472a-862a-560bbb5e2d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:12.612066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca9791-a085-472a-862a-560bbb5e2d31 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:12.612338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca9791-a085-472a-862a-560bbb5e2d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:12.612605 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca9791-a085-472a-862a-560bbb5e2d31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:12.613720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca9791-a085-472a-862a-560bbb5e2d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:12.615198 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca9791-a085-472a-862a-560bbb5e2d31 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:12.616794 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 77/152] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:12.617565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca9791-a085-472a-862a-560bbb5e2d31 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:12.645047 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:12.685680 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb2166-4636-4500-a37b-fec844c53cca None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:12.687206 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:12.719373 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e60f1f-13e8-47df-bbd4-6ce2baeb4796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:12.719965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e60f1f-13e8-47df-bbd4-6ce2baeb4796 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:12.720240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e60f1f-13e8-47df-bbd4-6ce2baeb4796 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:12.720507 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e60f1f-13e8-47df-bbd4-6ce2baeb4796 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:12.721158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e60f1f-13e8-47df-bbd4-6ce2baeb4796 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:12.721483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e60f1f-13e8-47df-bbd4-6ce2baeb4796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:12.721588 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca9791-a085-472a-862a-560bbb5e2d31 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:12.722886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e60f1f-13e8-47df-bbd4-6ce2baeb4796 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:12.731307 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 76/153] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:12.731307 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e60f1f-13e8-47df-bbd4-6ce2baeb4796 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:12.757180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047e436-b014-4f45-ab6e-e0ac9de90003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:12.757820 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047e436-b014-4f45-ab6e-e0ac9de90003 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:12.758091 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047e436-b014-4f45-ab6e-e0ac9de90003 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:12.758357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047e436-b014-4f45-ab6e-e0ac9de90003 None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:12.760095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047e436-b014-4f45-ab6e-e0ac9de90003 None admin] RBAC: Authorizing `identity:get_project(project_id=b4b4cae986dd47d99c03d6174a8a464a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:12.761546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047e436-b014-4f45-ab6e-e0ac9de90003 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:12.763142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 78/154] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:12 2022] GET /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:12.763886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047e436-b014-4f45-ab6e-e0ac9de90003 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:12.832594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e60f1f-13e8-47df-bbd4-6ce2baeb4796 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:12.854961 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:12.863725 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047e436-b014-4f45-ab6e-e0ac9de90003 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:12.866496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461a453-e532-446c-8ee8-bb2647b0ca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:12.867100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a453-e532-446c-8ee8-bb2647b0ca07 None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:12.867373 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a453-e532-446c-8ee8-bb2647b0ca07 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:12.867668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a453-e532-446c-8ee8-bb2647b0ca07 None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:12.868372 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461a453-e532-446c-8ee8-bb2647b0ca07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:12.869950 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461a453-e532-446c-8ee8-bb2647b0ca07 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:12.935187 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea9820-ae8d-4ff3-93bc-cdb8eeba3497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:12.935803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9820-ae8d-4ff3-93bc-cdb8eeba3497 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:12.936077 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9820-ae8d-4ff3-93bc-cdb8eeba3497 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:12.936415 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9820-ae8d-4ff3-93bc-cdb8eeba3497 None admin] PATH_INFO: `/v3/users/dfb342ff3fec4b8498d738dfc4f656a3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:12.937475 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea9820-ae8d-4ff3-93bc-cdb8eeba3497 None admin] RBAC: Authorizing `identity:get_user(user_id=dfb342ff3fec4b8498d738dfc4f656a3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:12.938902 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea9820-ae8d-4ff3-93bc-cdb8eeba3497 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:12.940450 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 79/155] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:12 2022] GET /identity/v3/users/dfb342ff3fec4b8498d738dfc4f656a3 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:12.941257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea9820-ae8d-4ff3-93bc-cdb8eeba3497 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:13.040429 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea9820-ae8d-4ff3-93bc-cdb8eeba3497 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:13.042106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 77/156] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:47:12 2022] POST /identity/v3/users => generated 297 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:13.042973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461a453-e532-446c-8ee8-bb2647b0ca07 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:13.078314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:13.079364 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a341dc3-b00b-4876-9301-86a4bfe56253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:13.080043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a341dc3-b00b-4876-9301-86a4bfe56253 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:13.080342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a341dc3-b00b-4876-9301-86a4bfe56253 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:13.080651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a341dc3-b00b-4876-9301-86a4bfe56253 None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a/users/dfb342ff3fec4b8498d738dfc4f656a3/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:13.082754 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a341dc3-b00b-4876-9301-86a4bfe56253 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4b4cae986dd47d99c03d6174a8a464a, user_id=dfb342ff3fec4b8498d738dfc4f656a3, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:13.084174 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a341dc3-b00b-4876-9301-86a4bfe56253 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:13.164358 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461a453-e532-446c-8ee8-bb2647b0ca07 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:13.191463 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 80/157] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:12 2022] PUT /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a/users/dfb342ff3fec4b8498d738dfc4f656a3/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:13.201876 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef3e36-295c-4e89-aacc-ed9731b42afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:13.202535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3e36-295c-4e89-aacc-ed9731b42afd None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:13.202810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3e36-295c-4e89-aacc-ed9731b42afd None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:13.203078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef3e36-295c-4e89-aacc-ed9731b42afd None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:13.204478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef3e36-295c-4e89-aacc-ed9731b42afd None admin] RBAC: Authorizing `identity:get_project(project_id=b4b4cae986dd47d99c03d6174a8a464a)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:13.206109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef3e36-295c-4e89-aacc-ed9731b42afd None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:13.208115 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 78/158] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:13 2022] GET /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:13.214315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a341dc3-b00b-4876-9301-86a4bfe56253 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:13.241141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:13.329422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a341dc3-b00b-4876-9301-86a4bfe56253 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:13.368866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd9c10-6f19-448a-b714-80cd32032eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:13.369495 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd9c10-6f19-448a-b714-80cd32032eea None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:13.369773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd9c10-6f19-448a-b714-80cd32032eea None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:13.370040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd9c10-6f19-448a-b714-80cd32032eea None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a/users/dfb342ff3fec4b8498d738dfc4f656a3/roles/80aa63d20ae84a66991d542b3ed87f66` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:13.372223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd9c10-6f19-448a-b714-80cd32032eea None admin] RBAC: Authorizing `identity:create_grant(project_id=b4b4cae986dd47d99c03d6174a8a464a, user_id=dfb342ff3fec4b8498d738dfc4f656a3, role_id=80aa63d20ae84a66991d542b3ed87f66)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:13.373796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd9c10-6f19-448a-b714-80cd32032eea None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:13.469727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 81/159] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:13 2022] PUT /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a/users/dfb342ff3fec4b8498d738dfc4f656a3/roles/80aa63d20ae84a66991d542b3ed87f66 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:15.393129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8d1bf-b0da-4aed-ae25-7c0832c85ccc None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:15.394102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8d1bf-b0da-4aed-ae25-7c0832c85ccc None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:15.394611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8d1bf-b0da-4aed-ae25-7c0832c85ccc None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:15.396449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 79/160] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:15.402535 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723892c3-49cd-434e-b897-467dd774a4e2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:15.403345 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723892c3-49cd-434e-b897-467dd774a4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:15.403814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723892c3-49cd-434e-b897-467dd774a4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:15.407658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0f6c-f3cd-426f-a61d-5697a366245e None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:15.407935 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0f6c-f3cd-426f-a61d-5697a366245e None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:15.408205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0f6c-f3cd-426f-a61d-5697a366245e None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:15.409646 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 80/161] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:47:15.414568 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b3df5-5afd-4d09-996d-ee7b808dd667 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:15.414924 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b3df5-5afd-4d09-996d-ee7b808dd667 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:15.415202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b3df5-5afd-4d09-996d-ee7b808dd667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:15.431188 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-723892c3-49cd-434e-b897-467dd774a4e2 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:15.432788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-723892c3-49cd-434e-b897-467dd774a4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:15.434098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e75b3df5-5afd-4d09-996d-ee7b808dd667 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:15.435259 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e75b3df5-5afd-4d09-996d-ee7b808dd667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:15.504245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 82/162] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:15.505218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 81/163] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:15.506544 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97741665-c04d-40d7-806f-3cfa6550eaa7 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:15.507036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97741665-c04d-40d7-806f-3cfa6550eaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:15.507518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97741665-c04d-40d7-806f-3cfa6550eaa7 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:15.509423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 83/164] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:15.520417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce0caf-a352-42a9-919e-dc5de31b1783 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:15.520417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce0caf-a352-42a9-919e-dc5de31b1783 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:15.520417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce0caf-a352-42a9-919e-dc5de31b1783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:15.541911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f7ce0caf-a352-42a9-919e-dc5de31b1783 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:15.543211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f7ce0caf-a352-42a9-919e-dc5de31b1783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:15.558889 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:15.615276 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 82/165] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:15.634876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adbdb6-a9ed-49fb-8154-ced20396c255 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:15.635233 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adbdb6-a9ed-49fb-8154-ced20396c255 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:15.635590 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adbdb6-a9ed-49fb-8154-ced20396c255 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:15.637109 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 84/166] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:15.642459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da86dce-60f8-4cb0-8075-9d31c3962aab None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:15.642945 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da86dce-60f8-4cb0-8075-9d31c3962aab None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:15.643439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da86dce-60f8-4cb0-8075-9d31c3962aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:15.662934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-6da86dce-60f8-4cb0-8075-9d31c3962aab None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:15.664353 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6da86dce-60f8-4cb0-8075-9d31c3962aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:15.737890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 83/167] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:15.783381 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adbdb6-a9ed-49fb-8154-ced20396c255 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:15.788274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da86dce-60f8-4cb0-8075-9d31c3962aab None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:15.796645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:15.887769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adbdb6-a9ed-49fb-8154-ced20396c255 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:15.897722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:15.923784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da86dce-60f8-4cb0-8075-9d31c3962aab None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:15.925979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba1331-4c47-4d55-b552-ef3c501d001d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:15.926612 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba1331-4c47-4d55-b552-ef3c501d001d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:15.926895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba1331-4c47-4d55-b552-ef3c501d001d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:15.933019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba1331-4c47-4d55-b552-ef3c501d001d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:15.937657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba1331-4c47-4d55-b552-ef3c501d001d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-6eba1331-4c47-4d55-b552-ef3c501d001d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:15.942466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:15.943477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 85/168] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:15.944362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba1331-4c47-4d55-b552-ef3c501d001d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:15.961504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2a869-7f2d-4ae4-bddb-4f5e8d738e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:15.962109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2a869-7f2d-4ae4-bddb-4f5e8d738e6b None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:15.962384 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2a869-7f2d-4ae4-bddb-4f5e8d738e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:15.962720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2a869-7f2d-4ae4-bddb-4f5e8d738e6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2a869-7f2d-4ae4-bddb-4f5e8d738e6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-adf2a869-7f2d-4ae4-bddb-4f5e8d738e6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:15.984407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:15.985890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:47:15.986949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:15.987898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 84/169] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:47:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:47:15.990132 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2a869-7f2d-4ae4-bddb-4f5e8d738e6b None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:16.028936 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:16.060677 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba1331-4c47-4d55-b552-ef3c501d001d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:16.091602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2a869-7f2d-4ae4-bddb-4f5e8d738e6b None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:16.092879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d92e10-aff8-4535-b130-dcd1ba29a8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:16.093520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d92e10-aff8-4535-b130-dcd1ba29a8ac None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:16.093795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d92e10-aff8-4535-b130-dcd1ba29a8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:16.094069 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d92e10-aff8-4535-b130-dcd1ba29a8ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:16.095185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d92e10-aff8-4535-b130-dcd1ba29a8ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:16.096620 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d92e10-aff8-4535-b130-dcd1ba29a8ac None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:16.098282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 86/170] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:16.099113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d92e10-aff8-4535-b130-dcd1ba29a8ac None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:16.126379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aec487-4245-4eb8-8b7d-1aecb121c44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:16.126976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aec487-4245-4eb8-8b7d-1aecb121c44e None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:16.127249 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aec487-4245-4eb8-8b7d-1aecb121c44e None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:16.127518 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aec487-4245-4eb8-8b7d-1aecb121c44e None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:16.128170 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aec487-4245-4eb8-8b7d-1aecb121c44e None admin] RBAC: Adding query filter params (name=member) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:16.128465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aec487-4245-4eb8-8b7d-1aecb121c44e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:16.129887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aec487-4245-4eb8-8b7d-1aecb121c44e None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:16.134824 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:16.138320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 85/171] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:16.138908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aec487-4245-4eb8-8b7d-1aecb121c44e None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:16.201342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d92e10-aff8-4535-b130-dcd1ba29a8ac None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:16.236012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf19b8-1907-4931-8066-6c26682ee72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:16.236615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf19b8-1907-4931-8066-6c26682ee72f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:16.236893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf19b8-1907-4931-8066-6c26682ee72f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:16.237073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aec487-4245-4eb8-8b7d-1aecb121c44e None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:16.237196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf19b8-1907-4931-8066-6c26682ee72f None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:16.237851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf19b8-1907-4931-8066-6c26682ee72f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:16.238151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf19b8-1907-4931-8066-6c26682ee72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:16.239522 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf19b8-1907-4931-8066-6c26682ee72f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:16.244494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:16.249158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 87/172] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:16.250065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf19b8-1907-4931-8066-6c26682ee72f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:16.271927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7eb5f3-b0f7-4438-9312-3dcdcba2f447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:16.272548 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7eb5f3-b0f7-4438-9312-3dcdcba2f447 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:16.272819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7eb5f3-b0f7-4438-9312-3dcdcba2f447 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:16.273083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7eb5f3-b0f7-4438-9312-3dcdcba2f447 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:16.284017 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7eb5f3-b0f7-4438-9312-3dcdcba2f447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-ec7eb5f3-b0f7-4438-9312-3dcdcba2f447 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:16.289328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:16.291005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 86/173] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:47:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:16.291794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7eb5f3-b0f7-4438-9312-3dcdcba2f447 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:16.348959 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:16.355210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf19b8-1907-4931-8066-6c26682ee72f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:16.389497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7eb5f3-b0f7-4438-9312-3dcdcba2f447 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:16.391259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f0ecc-732f-4253-ae41-ed5c22177c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:16.391860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f0ecc-732f-4253-ae41-ed5c22177c1e None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:16.392737 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f0ecc-732f-4253-ae41-ed5c22177c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:16.392737 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f0ecc-732f-4253-ae41-ed5c22177c1e None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:16.393018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f0ecc-732f-4253-ae41-ed5c22177c1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:16.394494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f0ecc-732f-4253-ae41-ed5c22177c1e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:16.424856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7f483-b37e-4772-872a-52e258d26bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:16.425506 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f483-b37e-4772-872a-52e258d26bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:16.428857 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f483-b37e-4772-872a-52e258d26bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:16.428857 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7f483-b37e-4772-872a-52e258d26bf8 None admin] PATH_INFO: `/v3/users/25be01f4591d4ccb94d4bdc19121365d` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:16.439456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7f483-b37e-4772-872a-52e258d26bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=25be01f4591d4ccb94d4bdc19121365d)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:16.440896 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7f483-b37e-4772-872a-52e258d26bf8 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:16.442524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 87/174] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:16 2022] GET /identity/v3/users/25be01f4591d4ccb94d4bdc19121365d => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:16.443274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7f483-b37e-4772-872a-52e258d26bf8 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:16.540279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7f483-b37e-4772-872a-52e258d26bf8 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:16.558110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:16.574346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913e33-073e-4bc8-a6a4-0208d165527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:16.574969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913e33-073e-4bc8-a6a4-0208d165527b None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:16.575245 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913e33-073e-4bc8-a6a4-0208d165527b None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:16.575516 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94913e33-073e-4bc8-a6a4-0208d165527b None admin] PATH_INFO: `/v3/users/dfb342ff3fec4b8498d738dfc4f656a3` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:16.576620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913e33-073e-4bc8-a6a4-0208d165527b None admin] RBAC: Authorizing `identity:get_user(user_id=dfb342ff3fec4b8498d738dfc4f656a3)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:16.578089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94913e33-073e-4bc8-a6a4-0208d165527b None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:16.579696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 88/175] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:16 2022] GET /identity/v3/users/dfb342ff3fec4b8498d738dfc4f656a3 => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:16.580435 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913e33-073e-4bc8-a6a4-0208d165527b None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:16.677091 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94913e33-073e-4bc8-a6a4-0208d165527b None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:16.688001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 88/176] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:47:16 2022] POST /identity/v3/users => generated 297 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:16.688829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f0ecc-732f-4253-ae41-ed5c22177c1e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:16.725465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab254d6-2404-4df5-812d-834c78bd2908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:16.726071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab254d6-2404-4df5-812d-834c78bd2908 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:16.726345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab254d6-2404-4df5-812d-834c78bd2908 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:16.726611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab254d6-2404-4df5-812d-834c78bd2908 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:16.727823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab254d6-2404-4df5-812d-834c78bd2908 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:16.728185 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab254d6-2404-4df5-812d-834c78bd2908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:16.729887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab254d6-2404-4df5-812d-834c78bd2908 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:16.741324 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 89/177] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:16.741324 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab254d6-2404-4df5-812d-834c78bd2908 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:16.760141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:16.808345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:16.808639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f0ecc-732f-4253-ae41-ed5c22177c1e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:16.845390 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b52d5-0141-4e33-b364-f6d5db03fa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:16.846043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b52d5-0141-4e33-b364-f6d5db03fa53 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:16.846317 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b52d5-0141-4e33-b364-f6d5db03fa53 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:16.846586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b52d5-0141-4e33-b364-f6d5db03fa53 None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:16.847753 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b52d5-0141-4e33-b364-f6d5db03fa53 None admin] RBAC: Authorizing `identity:get_project(project_id=b4b4cae986dd47d99c03d6174a8a464a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:16.849224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b52d5-0141-4e33-b364-f6d5db03fa53 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:16.854326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab254d6-2404-4df5-812d-834c78bd2908 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:16.855951 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 89/178] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:16 2022] GET /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:16.856893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b52d5-0141-4e33-b364-f6d5db03fa53 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:16.893764 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee3336-48ea-4463-9da0-03dff6ebf97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:16.894282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee3336-48ea-4463-9da0-03dff6ebf97c None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:16.895278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee3336-48ea-4463-9da0-03dff6ebf97c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:16.895278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee3336-48ea-4463-9da0-03dff6ebf97c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:16.968208 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee3336-48ea-4463-9da0-03dff6ebf97c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:16.969784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee3336-48ea-4463-9da0-03dff6ebf97c None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:17.025954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:17.067654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b52d5-0141-4e33-b364-f6d5db03fa53 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:17.090968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 90/179] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:17.092007 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee3336-48ea-4463-9da0-03dff6ebf97c None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:17.101645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:17.111320 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f23de-83fa-45d7-8059-5bac696d44e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:17.111960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f23de-83fa-45d7-8059-5bac696d44e5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:17.121426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f23de-83fa-45d7-8059-5bac696d44e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:17.121426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f23de-83fa-45d7-8059-5bac696d44e5 None admin] PATH_INFO: `/v3/users/dfb342ff3fec4b8498d738dfc4f656a3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:17.121426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f23de-83fa-45d7-8059-5bac696d44e5 None admin] RBAC: Authorizing `identity:get_user(user_id=dfb342ff3fec4b8498d738dfc4f656a3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:17.121426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f23de-83fa-45d7-8059-5bac696d44e5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:17.121426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 90/180] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:16 2022] GET /identity/v3/users/dfb342ff3fec4b8498d738dfc4f656a3 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:17.121426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f23de-83fa-45d7-8059-5bac696d44e5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:17.203542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee3336-48ea-4463-9da0-03dff6ebf97c None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:17.225113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f23de-83fa-45d7-8059-5bac696d44e5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:17.241339 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952c10f-6e7a-4b61-948f-44f03c345674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:17.242019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952c10f-6e7a-4b61-948f-44f03c345674 None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:17.242306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952c10f-6e7a-4b61-948f-44f03c345674 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:17.242729 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952c10f-6e7a-4b61-948f-44f03c345674 None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a/users/25be01f4591d4ccb94d4bdc19121365d/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:17.244893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952c10f-6e7a-4b61-948f-44f03c345674 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4b4cae986dd47d99c03d6174a8a464a, user_id=25be01f4591d4ccb94d4bdc19121365d, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:17.246442 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952c10f-6e7a-4b61-948f-44f03c345674 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:17.262442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886ce35-a066-40f3-9c4c-87f70aec1ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:17.264136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886ce35-a066-40f3-9c4c-87f70aec1ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:17.264136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886ce35-a066-40f3-9c4c-87f70aec1ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:17.264136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886ce35-a066-40f3-9c4c-87f70aec1ab6 None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:17.265104 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886ce35-a066-40f3-9c4c-87f70aec1ab6 None admin] RBAC: Authorizing `identity:get_project(project_id=b4b4cae986dd47d99c03d6174a8a464a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:17.266713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886ce35-a066-40f3-9c4c-87f70aec1ab6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:17.268582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 91/181] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:17 2022] GET /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:17.273508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886ce35-a066-40f3-9c4c-87f70aec1ab6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:17.330530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 91/182] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:17 2022] PUT /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a/users/25be01f4591d4ccb94d4bdc19121365d/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:17.333871 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952c10f-6e7a-4b61-948f-44f03c345674 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:17.350331 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:17.356762 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:17.428825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886ce35-a066-40f3-9c4c-87f70aec1ab6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:17.469521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952c10f-6e7a-4b61-948f-44f03c345674 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:17.491058 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7d794-d85c-4794-b49d-456464af2e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:17.491682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7d794-d85c-4794-b49d-456464af2e5f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:17.491960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7d794-d85c-4794-b49d-456464af2e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:17.492227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7d794-d85c-4794-b49d-456464af2e5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:17.509777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1a2f3-f33d-41c6-92a8-425666ebed6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:17.510394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1a2f3-f33d-41c6-92a8-425666ebed6e None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:17.510669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1a2f3-f33d-41c6-92a8-425666ebed6e None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:17.510937 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1a2f3-f33d-41c6-92a8-425666ebed6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:17.511671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1a2f3-f33d-41c6-92a8-425666ebed6e None admin] RBAC: Adding query filter params (role.id=c62ffefc63e74a1280bef2b6a22202ad, scope.project.id=b4b4cae986dd47d99c03d6174a8a464a, user.id=dfb342ff3fec4b8498d738dfc4f656a3) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:17.511975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1a2f3-f33d-41c6-92a8-425666ebed6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:17.513485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1a2f3-f33d-41c6-92a8-425666ebed6e None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:17.528296 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 92/183] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:47:17 2022] GET /identity/v3/role_assignments?user.id=dfb342ff3fec4b8498d738dfc4f656a3&scope.project.id=b4b4cae986dd47d99c03d6174a8a464a&role.id=c62ffefc63e74a1280bef2b6a22202ad => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:17.601759 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7d794-d85c-4794-b49d-456464af2e5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:17.603957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7d794-d85c-4794-b49d-456464af2e5f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:17.686683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:17.747756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 92/184] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:17.753623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1a2f3-f33d-41c6-92a8-425666ebed6e None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:17.848604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:17.881968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1a2f3-f33d-41c6-92a8-425666ebed6e None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:17.926831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ffe9a-1bf0-430c-8da7-e5b65ca5b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:17.927992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ffe9a-1bf0-430c-8da7-e5b65ca5b838 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:17.928490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ffe9a-1bf0-430c-8da7-e5b65ca5b838 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:17.928960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ffe9a-1bf0-430c-8da7-e5b65ca5b838 None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:17.932730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ffe9a-1bf0-430c-8da7-e5b65ca5b838 None admin] RBAC: Authorizing `identity:get_project(project_id=b4b4cae986dd47d99c03d6174a8a464a)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:17.934790 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ffe9a-1bf0-430c-8da7-e5b65ca5b838 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:17.937002 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 93/185] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:17 2022] GET /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:17.946670 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7d794-d85c-4794-b49d-456464af2e5f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:18.060214 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7d794-d85c-4794-b49d-456464af2e5f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:18.095272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b88769-5e00-4635-9d57-203520559f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:18.095877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b88769-5e00-4635-9d57-203520559f31 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:18.096154 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b88769-5e00-4635-9d57-203520559f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:18.096426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b88769-5e00-4635-9d57-203520559f31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:18.097142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b88769-5e00-4635-9d57-203520559f31 None admin] RBAC: Adding query filter params (role.id=80aa63d20ae84a66991d542b3ed87f66, scope.project.id=b4b4cae986dd47d99c03d6174a8a464a, user.id=dfb342ff3fec4b8498d738dfc4f656a3) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:18.097489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b88769-5e00-4635-9d57-203520559f31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:18.098920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b88769-5e00-4635-9d57-203520559f31 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:18.105720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 93/186] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:47:17 2022] GET /identity/v3/role_assignments?user.id=dfb342ff3fec4b8498d738dfc4f656a3&scope.project.id=b4b4cae986dd47d99c03d6174a8a464a&role.id=80aa63d20ae84a66991d542b3ed87f66 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:19.097073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba28d8-fec3-4803-aa56-41419d5316fb None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.097612 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba28d8-fec3-4803-aa56-41419d5316fb None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.097684 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba28d8-fec3-4803-aa56-41419d5316fb None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.099025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 94/187] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:47:19.104684 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5518b-9ed3-4aee-a24b-9d1f6d855010 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.105119 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5518b-9ed3-4aee-a24b-9d1f6d855010 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.105334 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5518b-9ed3-4aee-a24b-9d1f6d855010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.123829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-41e5518b-9ed3-4aee-a24b-9d1f6d855010 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:19.125038 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-41e5518b-9ed3-4aee-a24b-9d1f6d855010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:19.145328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:19.198395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 94/188] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:19.254774 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a5e7b-47d0-4393-9477-e6a5b8ef5824 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.255043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a5e7b-47d0-4393-9477-e6a5b8ef5824 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.255240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a5e7b-47d0-4393-9477-e6a5b8ef5824 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.256711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 95/189] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:19.261801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70055b-4093-41ba-b3b0-03c491d55a8e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.262087 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70055b-4093-41ba-b3b0-03c491d55a8e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.262360 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70055b-4093-41ba-b3b0-03c491d55a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.280963 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5d70055b-4093-41ba-b3b0-03c491d55a8e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:19.282166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5d70055b-4093-41ba-b3b0-03c491d55a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:19.348763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 95/190] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:19.466086 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a5e7b-47d0-4393-9477-e6a5b8ef5824 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:19.568345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a5e7b-47d0-4393-9477-e6a5b8ef5824 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:19.603810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e641d4-41ff-42be-b31e-1f6ac4a4b329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:19.604462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e641d4-41ff-42be-b31e-1f6ac4a4b329 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.604735 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e641d4-41ff-42be-b31e-1f6ac4a4b329 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.605003 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e641d4-41ff-42be-b31e-1f6ac4a4b329 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.614133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:19.617438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e641d4-41ff-42be-b31e-1f6ac4a4b329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-56e641d4-41ff-42be-b31e-1f6ac4a4b329 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:19.622457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:19.623388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:19.624167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:19.624167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:19.624167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:19.624167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:19.624167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:19.624167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:19.624167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:19.624167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:19.624167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:19.624167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:19.624167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:19.624167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:19.624167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 96/191] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:19.631014 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70055b-4093-41ba-b3b0-03c491d55a8e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:19.654541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e641d4-41ff-42be-b31e-1f6ac4a4b329 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:19.729231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:19.744516 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70055b-4093-41ba-b3b0-03c491d55a8e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:19.760009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e641d4-41ff-42be-b31e-1f6ac4a4b329 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:19.778213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf01ce0-03bd-4f20-ae0b-3abe29502f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:19.778814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf01ce0-03bd-4f20-ae0b-3abe29502f4f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.779091 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf01ce0-03bd-4f20-ae0b-3abe29502f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.779623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf01ce0-03bd-4f20-ae0b-3abe29502f4f None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.780288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf01ce0-03bd-4f20-ae0b-3abe29502f4f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:19.780584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf01ce0-03bd-4f20-ae0b-3abe29502f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:19.781976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf01ce0-03bd-4f20-ae0b-3abe29502f4f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:19.794439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 96/192] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:19.794439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd0118-d6ad-4feb-8d26-21718449fbf4 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.794439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd0118-d6ad-4feb-8d26-21718449fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.794439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd0118-d6ad-4feb-8d26-21718449fbf4 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.794439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 97/193] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:19.795992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd0118-d6ad-4feb-8d26-21718449fbf4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:19.798478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34831600-d7b8-4e28-86c7-f869eaf08f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:19.799105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34831600-d7b8-4e28-86c7-f869eaf08f5f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.800158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34831600-d7b8-4e28-86c7-f869eaf08f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.800158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34831600-d7b8-4e28-86c7-f869eaf08f5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.800795 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34831600-d7b8-4e28-86c7-f869eaf08f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:19.802280 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34831600-d7b8-4e28-86c7-f869eaf08f5f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:19.803881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 97/194] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:19.805198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f743c8d-9b22-42ab-99ae-df5aa23bc8f2 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.805513 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f743c8d-9b22-42ab-99ae-df5aa23bc8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.805781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f743c8d-9b22-42ab-99ae-df5aa23bc8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.823638 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-8f743c8d-9b22-42ab-99ae-df5aa23bc8f2 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:19.824757 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-8f743c8d-9b22-42ab-99ae-df5aa23bc8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:19.922284 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:19.926033 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd0118-d6ad-4feb-8d26-21718449fbf4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:19.927554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 98/195] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:19.928318 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f743c8d-9b22-42ab-99ae-df5aa23bc8f2 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:19.961644 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff6da-00c4-45ad-b3b7-9c32e2caedf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:19.962354 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff6da-00c4-45ad-b3b7-9c32e2caedf5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:19.962639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff6da-00c4-45ad-b3b7-9c32e2caedf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:19.962912 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff6da-00c4-45ad-b3b7-9c32e2caedf5 None admin] PATH_INFO: `/v3/users/29315510cf774e6b8599d3fc0ca60a50` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:19.979672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff6da-00c4-45ad-b3b7-9c32e2caedf5 None admin] RBAC: Authorizing `identity:get_user(user_id=29315510cf774e6b8599d3fc0ca60a50)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:19.981426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff6da-00c4-45ad-b3b7-9c32e2caedf5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:19.983543 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 98/196] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:19 2022] GET /identity/v3/users/29315510cf774e6b8599d3fc0ca60a50 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:19.988661 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff6da-00c4-45ad-b3b7-9c32e2caedf5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:19.994096 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:20.039354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f743c8d-9b22-42ab-99ae-df5aa23bc8f2 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.077351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7bf55-21df-4ad6-a197-80cae203ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.077903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7bf55-21df-4ad6-a197-80cae203ec51 None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.078177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7bf55-21df-4ad6-a197-80cae203ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.078448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7bf55-21df-4ad6-a197-80cae203ec51 None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.079091 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7bf55-21df-4ad6-a197-80cae203ec51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.080540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7bf55-21df-4ad6-a197-80cae203ec51 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.093983 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff6da-00c4-45ad-b3b7-9c32e2caedf5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.128600 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927376c-81e3-444a-bf48-fe1f588092b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.129227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927376c-81e3-444a-bf48-fe1f588092b6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.129519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927376c-81e3-444a-bf48-fe1f588092b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.129795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927376c-81e3-444a-bf48-fe1f588092b6 None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.131041 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927376c-81e3-444a-bf48-fe1f588092b6 None admin] RBAC: Authorizing `identity:get_project(project_id=b4b4cae986dd47d99c03d6174a8a464a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.132508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927376c-81e3-444a-bf48-fe1f588092b6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.135017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 99/197] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:19 2022] GET /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:20.140545 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927376c-81e3-444a-bf48-fe1f588092b6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:20.184919 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 99/198] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:47:19 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:20.203509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7bf55-21df-4ad6-a197-80cae203ec51 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:20.221631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:20.254533 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927376c-81e3-444a-bf48-fe1f588092b6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.266405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:20.297924 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d35062-c5d0-47a7-a5e7-db839258364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.298610 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d35062-c5d0-47a7-a5e7-db839258364b None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.298884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d35062-c5d0-47a7-a5e7-db839258364b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.299153 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d35062-c5d0-47a7-a5e7-db839258364b None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a/users/29315510cf774e6b8599d3fc0ca60a50/roles/2e8a422395c1407e9f923b187fe96450` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.301959 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d35062-c5d0-47a7-a5e7-db839258364b None admin] RBAC: Authorizing `identity:create_grant(project_id=b4b4cae986dd47d99c03d6174a8a464a, user_id=29315510cf774e6b8599d3fc0ca60a50, role_id=2e8a422395c1407e9f923b187fe96450)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.303416 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d35062-c5d0-47a7-a5e7-db839258364b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.317061 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7bf55-21df-4ad6-a197-80cae203ec51 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.353922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d84986-9b9c-40f2-ba6d-be4326a87fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.354474 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84986-9b9c-40f2-ba6d-be4326a87fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.354752 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84986-9b9c-40f2-ba6d-be4326a87fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.355019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84986-9b9c-40f2-ba6d-be4326a87fa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.365715 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d84986-9b9c-40f2-ba6d-be4326a87fa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-a2d84986-9b9c-40f2-ba6d-be4326a87fa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:20.371668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:20.372698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:20.373556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:20.373556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:20.373556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:20.373556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:20.373556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:20.373556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:20.373556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:20.373556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:20.373556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:20.373556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:20.373556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:20.373556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:20.373556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 100/199] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:47:20.378681 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d84986-9b9c-40f2-ba6d-be4326a87fa4 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:20.429721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 100/200] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:20 2022] PUT /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a/users/29315510cf774e6b8599d3fc0ca60a50/roles/2e8a422395c1407e9f923b187fe96450 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:47:20.502427 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d84986-9b9c-40f2-ba6d-be4326a87fa4 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.519185 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:20.545518 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf4eb5-6658-4a14-84d5-ba76ab50a13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.546149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf4eb5-6658-4a14-84d5-ba76ab50a13f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.546429 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf4eb5-6658-4a14-84d5-ba76ab50a13f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.546701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf4eb5-6658-4a14-84d5-ba76ab50a13f None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.547391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf4eb5-6658-4a14-84d5-ba76ab50a13f None admin] RBAC: Adding query filter params (name=member) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:20.547694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf4eb5-6658-4a14-84d5-ba76ab50a13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.549102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf4eb5-6658-4a14-84d5-ba76ab50a13f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.560383 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 101/201] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:20.566371 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d35062-c5d0-47a7-a5e7-db839258364b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:20.682598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d35062-c5d0-47a7-a5e7-db839258364b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.714515 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:20.720019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec73441-644f-4e18-88cb-cd90f03caa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.720941 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec73441-644f-4e18-88cb-cd90f03caa23 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.721423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec73441-644f-4e18-88cb-cd90f03caa23 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.721855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec73441-644f-4e18-88cb-cd90f03caa23 None admin] PATH_INFO: `/v3/users/25be01f4591d4ccb94d4bdc19121365d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.723191 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec73441-644f-4e18-88cb-cd90f03caa23 None admin] RBAC: Authorizing `identity:get_user(user_id=25be01f4591d4ccb94d4bdc19121365d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.724793 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec73441-644f-4e18-88cb-cd90f03caa23 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:20.730088 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 101/202] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:20 2022] GET /identity/v3/users/25be01f4591d4ccb94d4bdc19121365d => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:20.732919 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf4eb5-6658-4a14-84d5-ba76ab50a13f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:20.843267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf4eb5-6658-4a14-84d5-ba76ab50a13f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:20.882030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c938b13-659e-402b-93c5-330c8d74f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:20.883032 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938b13-659e-402b-93c5-330c8d74f467 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:20.883559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938b13-659e-402b-93c5-330c8d74f467 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:20.884019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938b13-659e-402b-93c5-330c8d74f467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:20.945134 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:20.973612 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c938b13-659e-402b-93c5-330c8d74f467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:20.975092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c938b13-659e-402b-93c5-330c8d74f467 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:21.077732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 102/203] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:21.083363 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec73441-644f-4e18-88cb-cd90f03caa23 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:21.190951 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec73441-644f-4e18-88cb-cd90f03caa23 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:21.226807 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f30db0-5058-4b3c-b4a4-874142410ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:21.227942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f30db0-5058-4b3c-b4a4-874142410ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:21.228216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f30db0-5058-4b3c-b4a4-874142410ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:21.228487 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f30db0-5058-4b3c-b4a4-874142410ec9 None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:21.229721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f30db0-5058-4b3c-b4a4-874142410ec9 None admin] RBAC: Authorizing `identity:get_project(project_id=b4b4cae986dd47d99c03d6174a8a464a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:21.231164 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f30db0-5058-4b3c-b4a4-874142410ec9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:21.232792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 102/204] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:21 2022] GET /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:21.238938 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c938b13-659e-402b-93c5-330c8d74f467 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:21.322092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:21.349147 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c938b13-659e-402b-93c5-330c8d74f467 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:21.385985 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e349d-dc43-4bfd-b74e-9aea776b8397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:21.386595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e349d-dc43-4bfd-b74e-9aea776b8397 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:21.386870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e349d-dc43-4bfd-b74e-9aea776b8397 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:21.387141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e349d-dc43-4bfd-b74e-9aea776b8397 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:21.387863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e349d-dc43-4bfd-b74e-9aea776b8397 None admin] RBAC: Adding query filter params (role.id=c3f5b94962604da78f8e1a5d18105768, scope.project.id=b4b4cae986dd47d99c03d6174a8a464a, user.id=25be01f4591d4ccb94d4bdc19121365d) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:21.388228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e349d-dc43-4bfd-b74e-9aea776b8397 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:21.389781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e349d-dc43-4bfd-b74e-9aea776b8397 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:21.395764 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 103/205] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:47:21 2022] GET /identity/v3/role_assignments?user.id=25be01f4591d4ccb94d4bdc19121365d&scope.project.id=b4b4cae986dd47d99c03d6174a8a464a&role.id=c3f5b94962604da78f8e1a5d18105768 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:22.597746 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d15df5-ec16-42d7-9eed-297afd9a84ef None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:22.598303 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d15df5-ec16-42d7-9eed-297afd9a84ef None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:22.598303 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d15df5-ec16-42d7-9eed-297afd9a84ef None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:22.599830 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 103/206] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:22.605546 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42764660-6ff7-4233-a1ff-c13385ef5d12 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:22.606031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42764660-6ff7-4233-a1ff-c13385ef5d12 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:22.606101 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42764660-6ff7-4233-a1ff-c13385ef5d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:22.623931 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-42764660-6ff7-4233-a1ff-c13385ef5d12 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:22.625093 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-42764660-6ff7-4233-a1ff-c13385ef5d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:22.669532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d78c9-730a-406c-814c-1282e1c1cae5 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:22.669816 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d78c9-730a-406c-814c-1282e1c1cae5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:22.670096 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d78c9-730a-406c-814c-1282e1c1cae5 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:22.671573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 104/207] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:47:22.676370 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be0249-e59d-499e-9f7d-4d819c901230 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:22.676654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be0249-e59d-499e-9f7d-4d819c901230 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:22.676925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be0249-e59d-499e-9f7d-4d819c901230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:22.696282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-57be0249-e59d-499e-9f7d-4d819c901230 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:22.696961 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 104/208] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:22.697682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-57be0249-e59d-499e-9f7d-4d819c901230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:22.702638 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0366-0e43-4ab5-afd3-75b3421daf25 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:22.702922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0366-0e43-4ab5-afd3-75b3421daf25 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:22.703194 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0366-0e43-4ab5-afd3-75b3421daf25 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:22.704599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 105/209] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:22.709503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69aee1-81da-4c01-91b4-110228edc9c4 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:22.709787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69aee1-81da-4c01-91b4-110228edc9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:22.710064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69aee1-81da-4c01-91b4-110228edc9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:22.728812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-ec69aee1-81da-4c01-91b4-110228edc9c4 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:22.730019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ec69aee1-81da-4c01-91b4-110228edc9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:22.763478 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:22.773036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 105/210] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:22.797925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:22.802646 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 106/211] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:22.964907 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be0249-e59d-499e-9f7d-4d819c901230 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:23.056210 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69aee1-81da-4c01-91b4-110228edc9c4 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:23.073158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be0249-e59d-499e-9f7d-4d819c901230 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:23.108533 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714cd21-56a8-4b8f-b72c-a0c50f325125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:23.109162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714cd21-56a8-4b8f-b72c-a0c50f325125 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:23.109592 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714cd21-56a8-4b8f-b72c-a0c50f325125 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:23.109896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714cd21-56a8-4b8f-b72c-a0c50f325125 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:23.111023 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714cd21-56a8-4b8f-b72c-a0c50f325125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:23.112478 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714cd21-56a8-4b8f-b72c-a0c50f325125 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:23.114081 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 106/212] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:23.114081 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714cd21-56a8-4b8f-b72c-a0c50f325125 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:23.164446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69aee1-81da-4c01-91b4-110228edc9c4 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:23.180852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:23.198509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbcdcd-ca8f-4aa3-aa45-fee8f45f1b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:23.199137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbcdcd-ca8f-4aa3-aa45-fee8f45f1b31 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:23.199411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbcdcd-ca8f-4aa3-aa45-fee8f45f1b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:23.199676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbcdcd-ca8f-4aa3-aa45-fee8f45f1b31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:23.210227 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbcdcd-ca8f-4aa3-aa45-fee8f45f1b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:23.213697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714cd21-56a8-4b8f-b72c-a0c50f325125 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-a5bbcdcd-ca8f-4aa3-aa45-fee8f45f1b31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:23.215596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:23.216444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:23.217209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:23.217209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:23.217209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:23.217209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:23.217209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:23.217209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:23.217209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:23.217209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:23.217209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:23.217209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:23.217209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:23.217209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:23.217209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 107/213] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:47:23.217901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbcdcd-ca8f-4aa3-aa45-fee8f45f1b31 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:23.248340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d66c56-d19e-496e-8a62-3eacc22cc5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:23.249254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d66c56-d19e-496e-8a62-3eacc22cc5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:23.249564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d66c56-d19e-496e-8a62-3eacc22cc5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:23.249823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d66c56-d19e-496e-8a62-3eacc22cc5e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:23.260344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d66c56-d19e-496e-8a62-3eacc22cc5e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-b0d66c56-d19e-496e-8a62-3eacc22cc5e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:23.265126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:23.266216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:23.266998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:23.266998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:23.266998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:23.266998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:23.266998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:23.266998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:23.266998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:23.266998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:23.266998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:23.266998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:23.266998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:23.266998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:23.266998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 107/214] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:23.267697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d66c56-d19e-496e-8a62-3eacc22cc5e5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:23.278362 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:23.318378 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbcdcd-ca8f-4aa3-aa45-fee8f45f1b31 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:23.353133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709300e-9f33-4802-aea2-6ae0bbc4452b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:23.353756 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709300e-9f33-4802-aea2-6ae0bbc4452b None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:23.354026 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709300e-9f33-4802-aea2-6ae0bbc4452b None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:23.354287 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709300e-9f33-4802-aea2-6ae0bbc4452b None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:23.355342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709300e-9f33-4802-aea2-6ae0bbc4452b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:23.356776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709300e-9f33-4802-aea2-6ae0bbc4452b None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:23.366260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d66c56-d19e-496e-8a62-3eacc22cc5e5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:23.392892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:23.401751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a52f9e-20bf-4498-a51b-79dc8c10bbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:23.402350 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a52f9e-20bf-4498-a51b-79dc8c10bbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:23.402630 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a52f9e-20bf-4498-a51b-79dc8c10bbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:23.402902 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a52f9e-20bf-4498-a51b-79dc8c10bbb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:23.403558 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a52f9e-20bf-4498-a51b-79dc8c10bbb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:23.403859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a52f9e-20bf-4498-a51b-79dc8c10bbb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:23.405572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a52f9e-20bf-4498-a51b-79dc8c10bbb0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:23.413377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 108/215] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:23.414151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a52f9e-20bf-4498-a51b-79dc8c10bbb0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:23.494528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 108/216] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:47:23 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:23.496212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709300e-9f33-4802-aea2-6ae0bbc4452b None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:23.517396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a52f9e-20bf-4498-a51b-79dc8c10bbb0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:23.554739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7297cec-00d2-4a4f-a244-f5700ffd8e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:23.555471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7297cec-00d2-4a4f-a244-f5700ffd8e91 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:23.555862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7297cec-00d2-4a4f-a244-f5700ffd8e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:23.556152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7297cec-00d2-4a4f-a244-f5700ffd8e91 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:23.556818 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7297cec-00d2-4a4f-a244-f5700ffd8e91 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:23.557123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7297cec-00d2-4a4f-a244-f5700ffd8e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:23.558585 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7297cec-00d2-4a4f-a244-f5700ffd8e91 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:23.567639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 109/217] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:23.574698 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7297cec-00d2-4a4f-a244-f5700ffd8e91 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:23.623008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709300e-9f33-4802-aea2-6ae0bbc4452b None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:23.636571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:23.645187 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:23.664586 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78c3f8-1a21-4a24-8363-ba86131acf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:23.665247 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78c3f8-1a21-4a24-8363-ba86131acf0f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:23.665593 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78c3f8-1a21-4a24-8363-ba86131acf0f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:23.665851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78c3f8-1a21-4a24-8363-ba86131acf0f None admin] PATH_INFO: `/v3/users/d04aaf68e275463f8333ad36887ebf14` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:23.682678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78c3f8-1a21-4a24-8363-ba86131acf0f None admin] RBAC: Authorizing `identity:get_user(user_id=d04aaf68e275463f8333ad36887ebf14)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:23.684174 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78c3f8-1a21-4a24-8363-ba86131acf0f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:23.686586 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 109/218] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:23 2022] GET /identity/v3/users/d04aaf68e275463f8333ad36887ebf14 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:23.692583 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78c3f8-1a21-4a24-8363-ba86131acf0f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:23.697449 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7297cec-00d2-4a4f-a244-f5700ffd8e91 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:23.745960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2509e7-018a-4d58-ac8b-adeef408e761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:23.746555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2509e7-018a-4d58-ac8b-adeef408e761 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:23.746840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2509e7-018a-4d58-ac8b-adeef408e761 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:23.749094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2509e7-018a-4d58-ac8b-adeef408e761 None admin] PATH_INFO: `/v3/users/29315510cf774e6b8599d3fc0ca60a50` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:23.750086 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2509e7-018a-4d58-ac8b-adeef408e761 None admin] RBAC: Authorizing `identity:get_user(user_id=29315510cf774e6b8599d3fc0ca60a50)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:23.751584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2509e7-018a-4d58-ac8b-adeef408e761 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:23.753232 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 110/219] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:23 2022] GET /identity/v3/users/29315510cf774e6b8599d3fc0ca60a50 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:23.761013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2509e7-018a-4d58-ac8b-adeef408e761 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:23.828286 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78c3f8-1a21-4a24-8363-ba86131acf0f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:23.876948 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd17798-2a19-4fd3-bbf7-400f166c299f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:23.877793 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd17798-2a19-4fd3-bbf7-400f166c299f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:23.878067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd17798-2a19-4fd3-bbf7-400f166c299f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:23.878333 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd17798-2a19-4fd3-bbf7-400f166c299f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:23.879067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd17798-2a19-4fd3-bbf7-400f166c299f None admin] RBAC: Adding query filter params (role.id=c3f5b94962604da78f8e1a5d18105768, user.id=d04aaf68e275463f8333ad36887ebf14, scope.system=all) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:23.879368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd17798-2a19-4fd3-bbf7-400f166c299f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:23.880812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd17798-2a19-4fd3-bbf7-400f166c299f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:23.886915 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 110/220] 10.222.0.45 () {56 vars in 1308 bytes} [Mon Oct 31 14:47:23 2022] GET /identity/v3/role_assignments?user.id=d04aaf68e275463f8333ad36887ebf14&scope.system=all&role.id=c3f5b94962604da78f8e1a5d18105768 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:23.900858 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2509e7-018a-4d58-ac8b-adeef408e761 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:23.923819 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:23.944877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ac12e-11ca-455c-9589-2fe2112c2076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:23.948980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ac12e-11ca-455c-9589-2fe2112c2076 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:23.949279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ac12e-11ca-455c-9589-2fe2112c2076 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:23.949547 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ac12e-11ca-455c-9589-2fe2112c2076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:24.041439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ac12e-11ca-455c-9589-2fe2112c2076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:24.042974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ac12e-11ca-455c-9589-2fe2112c2076 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:24.158060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 111/221] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:24.163730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd17798-2a19-4fd3-bbf7-400f166c299f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:24.219129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:24.297466 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd17798-2a19-4fd3-bbf7-400f166c299f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:24.337209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c48099-06de-4f67-8064-71e0bd2230ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:24.337887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c48099-06de-4f67-8064-71e0bd2230ca None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:24.338164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c48099-06de-4f67-8064-71e0bd2230ca None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:24.338437 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c48099-06de-4f67-8064-71e0bd2230ca None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:24.339576 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c48099-06de-4f67-8064-71e0bd2230ca None admin] RBAC: Authorizing `identity:get_project(project_id=b4b4cae986dd47d99c03d6174a8a464a)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:24.341056 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c48099-06de-4f67-8064-71e0bd2230ca None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:24.342840 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 111/222] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:24 2022] GET /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:24.349047 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ac12e-11ca-455c-9589-2fe2112c2076 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:24.369014 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:24.464166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ac12e-11ca-455c-9589-2fe2112c2076 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:24.505254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea91fdf-b0a8-4349-994e-86f266c58655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:24.505899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea91fdf-b0a8-4349-994e-86f266c58655 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:24.506177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea91fdf-b0a8-4349-994e-86f266c58655 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:24.506449 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea91fdf-b0a8-4349-994e-86f266c58655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:24.507174 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea91fdf-b0a8-4349-994e-86f266c58655 None admin] RBAC: Adding query filter params (role.id=2e8a422395c1407e9f923b187fe96450, scope.project.id=b4b4cae986dd47d99c03d6174a8a464a, user.id=29315510cf774e6b8599d3fc0ca60a50) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:24.507481 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea91fdf-b0a8-4349-994e-86f266c58655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:24.508944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea91fdf-b0a8-4349-994e-86f266c58655 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:24.519816 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 112/223] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:47:24 2022] GET /identity/v3/role_assignments?user.id=29315510cf774e6b8599d3fc0ca60a50&scope.project.id=b4b4cae986dd47d99c03d6174a8a464a&role.id=2e8a422395c1407e9f923b187fe96450 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:25.987263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f2df5-5a9a-417c-a6e2-77cd3f53ffc4 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:25.987726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f2df5-5a9a-417c-a6e2-77cd3f53ffc4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:25.987799 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f2df5-5a9a-417c-a6e2-77cd3f53ffc4 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:25.989534 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 112/224] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:25.991143 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde9643-afad-4f51-a15e-02a5dce724a4 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:25.991539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde9643-afad-4f51-a15e-02a5dce724a4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:25.991735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde9643-afad-4f51-a15e-02a5dce724a4 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:25.993821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 113/225] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:47:25.994754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d449d3e-c61d-42b3-9f0c-58bf3655d991 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:25.995029 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d449d3e-c61d-42b3-9f0c-58bf3655d991 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:25.995298 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d449d3e-c61d-42b3-9f0c-58bf3655d991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:25.998807 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae8c25-a1ca-4003-a242-974c0adfea9e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:25.999111 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae8c25-a1ca-4003-a242-974c0adfea9e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:25.999403 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae8c25-a1ca-4003-a242-974c0adfea9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.014237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-9d449d3e-c61d-42b3-9f0c-58bf3655d991 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:26.015414 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9d449d3e-c61d-42b3-9f0c-58bf3655d991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:26.018472 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-40ae8c25-a1ca-4003-a242-974c0adfea9e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:26.019645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-40ae8c25-a1ca-4003-a242-974c0adfea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:26.092709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 113/226] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:26.109327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 114/227] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:26.155787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db7a7f-b2de-4afb-9973-ed75a66893af None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.156087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db7a7f-b2de-4afb-9973-ed75a66893af None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.156330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db7a7f-b2de-4afb-9973-ed75a66893af None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.157874 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 114/228] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:26.162718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7ad09-f863-4235-b04a-59b508852f56 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.163005 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7ad09-f863-4235-b04a-59b508852f56 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.163275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7ad09-f863-4235-b04a-59b508852f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.181434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-aca7ad09-f863-4235-b04a-59b508852f56 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:26.182595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aca7ad09-f863-4235-b04a-59b508852f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:26.190252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:26.248970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 115/229] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:26.359928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db7a7f-b2de-4afb-9973-ed75a66893af None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:26.374223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7ad09-f863-4235-b04a-59b508852f56 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:26.396511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:26.462089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db7a7f-b2de-4afb-9973-ed75a66893af None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:26.482421 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7ad09-f863-4235-b04a-59b508852f56 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:26.495531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8000f-e62a-4a48-894e-b60b1271ee62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:26.496155 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8000f-e62a-4a48-894e-b60b1271ee62 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.496426 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8000f-e62a-4a48-894e-b60b1271ee62 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.496694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8000f-e62a-4a48-894e-b60b1271ee62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.506693 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8000f-e62a-4a48-894e-b60b1271ee62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-66d8000f-e62a-4a48-894e-b60b1271ee62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:26.512140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:26.513186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:26.514139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:26.514139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:26.514139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:26.514139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:26.514139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:26.514139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:26.514139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:26.514139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:26.514139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:26.514139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:26.514139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:26.514139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:26.514139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 115/230] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:26.519036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8000f-e62a-4a48-894e-b60b1271ee62 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:26.521978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d520186-d5eb-41eb-816d-62f9fa8899aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:26.522616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d520186-d5eb-41eb-816d-62f9fa8899aa None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.522893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d520186-d5eb-41eb-816d-62f9fa8899aa None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.523162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d520186-d5eb-41eb-816d-62f9fa8899aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.524452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d520186-d5eb-41eb-816d-62f9fa8899aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:26.525950 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d520186-d5eb-41eb-816d-62f9fa8899aa None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:26.527506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 116/231] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:26.528252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d520186-d5eb-41eb-816d-62f9fa8899aa None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:26.541908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:26.614028 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:26.619556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8000f-e62a-4a48-894e-b60b1271ee62 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:26.627567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d520186-d5eb-41eb-816d-62f9fa8899aa None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:26.653796 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e715a-68d8-4bf5-8ba8-c87156e92366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:26.654724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e715a-68d8-4bf5-8ba8-c87156e92366 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.655005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e715a-68d8-4bf5-8ba8-c87156e92366 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.655270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e715a-68d8-4bf5-8ba8-c87156e92366 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.655932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e715a-68d8-4bf5-8ba8-c87156e92366 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:26.656256 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e715a-68d8-4bf5-8ba8-c87156e92366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:26.657681 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e715a-68d8-4bf5-8ba8-c87156e92366 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:26.661531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978c2f-716e-4902-8539-3f663563b2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:26.662151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978c2f-716e-4902-8539-3f663563b2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.662427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978c2f-716e-4902-8539-3f663563b2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.662700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978c2f-716e-4902-8539-3f663563b2a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.665988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 116/232] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:26.671037 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e715a-68d8-4bf5-8ba8-c87156e92366 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:26.676822 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b978c2f-716e-4902-8539-3f663563b2a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-7b978c2f-716e-4902-8539-3f663563b2a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:26.682307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:26.683378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:26.684189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:26.684189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:26.684189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:26.684189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:26.684189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:26.684189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:26.684189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:26.684189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:26.684189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:26.684189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:26.684189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:26.684189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:26.684189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 117/233] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:26.686574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978c2f-716e-4902-8539-3f663563b2a7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:26.756943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:26.765763 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e715a-68d8-4bf5-8ba8-c87156e92366 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:26.787172 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978c2f-716e-4902-8539-3f663563b2a7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:26.798488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3807550-975a-49d1-ab2d-eccba52093bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:26.799106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3807550-975a-49d1-ab2d-eccba52093bb None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.799384 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3807550-975a-49d1-ab2d-eccba52093bb None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.799653 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3807550-975a-49d1-ab2d-eccba52093bb None admin] PATH_INFO: `/v3/groups` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.800276 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3807550-975a-49d1-ab2d-eccba52093bb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:26.801771 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3807550-975a-49d1-ab2d-eccba52093bb None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:26.820718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ee7a0-0cb4-4e0b-8b9d-40d8f5275f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:26.821271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ee7a0-0cb4-4e0b-8b9d-40d8f5275f2b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.826015 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ee7a0-0cb4-4e0b-8b9d-40d8f5275f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.826015 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ee7a0-0cb4-4e0b-8b9d-40d8f5275f2b None admin] PATH_INFO: `/v3/users/095af67a695240e7b79796b3d0a18228` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.834124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ee7a0-0cb4-4e0b-8b9d-40d8f5275f2b None admin] RBAC: Authorizing `identity:get_user(user_id=095af67a695240e7b79796b3d0a18228)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:26.835556 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ee7a0-0cb4-4e0b-8b9d-40d8f5275f2b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:26.837818 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 118/234] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:26 2022] GET /identity/v3/users/095af67a695240e7b79796b3d0a18228 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:26.838652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ee7a0-0cb4-4e0b-8b9d-40d8f5275f2b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:26.897586 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 117/235] 10.222.0.45 () {60 vars in 1134 bytes} [Mon Oct 31 14:47:26 2022] POST /identity/v3/groups => generated 229 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:26.898471 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3807550-975a-49d1-ab2d-eccba52093bb None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:26.922086 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:26.947657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ee7a0-0cb4-4e0b-8b9d-40d8f5275f2b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:26.984084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:26.992597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad124b9-d1c7-45c3-aa04-e249ed38cb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:26.993337 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad124b9-d1c7-45c3-aa04-e249ed38cb99 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:26.993532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad124b9-d1c7-45c3-aa04-e249ed38cb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:26.993802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad124b9-d1c7-45c3-aa04-e249ed38cb99 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:26.994482 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad124b9-d1c7-45c3-aa04-e249ed38cb99 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:26.994798 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad124b9-d1c7-45c3-aa04-e249ed38cb99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:26.996350 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad124b9-d1c7-45c3-aa04-e249ed38cb99 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:27.006104 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 119/236] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:27.013210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad124b9-d1c7-45c3-aa04-e249ed38cb99 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:27.020908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3807550-975a-49d1-ab2d-eccba52093bb None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:27.063525 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89173-1327-4ed3-8f5d-ea6c09a075c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:27.064306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89173-1327-4ed3-8f5d-ea6c09a075c1 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:27.064581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89173-1327-4ed3-8f5d-ea6c09a075c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:27.064854 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89173-1327-4ed3-8f5d-ea6c09a075c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:27.084565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89173-1327-4ed3-8f5d-ea6c09a075c1 None admin] RBAC: Adding query filter params (role.id=2e8a422395c1407e9f923b187fe96450, user.id=095af67a695240e7b79796b3d0a18228, scope.system=all) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:27.084565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89173-1327-4ed3-8f5d-ea6c09a075c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:27.084565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f89173-1327-4ed3-8f5d-ea6c09a075c1 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:27.084565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 118/237] 10.222.0.45 () {56 vars in 1308 bytes} [Mon Oct 31 14:47:26 2022] GET /identity/v3/role_assignments?user.id=095af67a695240e7b79796b3d0a18228&scope.system=all&role.id=2e8a422395c1407e9f923b187fe96450 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:27.132863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad124b9-d1c7-45c3-aa04-e249ed38cb99 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:27.173404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b61140-61f9-4699-8e3a-252e1cfdc65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:27.174054 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b61140-61f9-4699-8e3a-252e1cfdc65d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:27.174332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b61140-61f9-4699-8e3a-252e1cfdc65d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:27.174604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b61140-61f9-4699-8e3a-252e1cfdc65d None admin] PATH_INFO: `/v3/users/d04aaf68e275463f8333ad36887ebf14` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:27.175773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b61140-61f9-4699-8e3a-252e1cfdc65d None admin] RBAC: Authorizing `identity:get_user(user_id=d04aaf68e275463f8333ad36887ebf14)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:27.177234 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b61140-61f9-4699-8e3a-252e1cfdc65d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:27.179087 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 120/238] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:27 2022] GET /identity/v3/users/d04aaf68e275463f8333ad36887ebf14 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:27.184837 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89173-1327-4ed3-8f5d-ea6c09a075c1 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:27.280048 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:27.298203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89173-1327-4ed3-8f5d-ea6c09a075c1 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:27.333979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b899ada-2761-48e3-8bc6-ba8cf8056115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:27.335005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b899ada-2761-48e3-8bc6-ba8cf8056115 None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:27.335472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b899ada-2761-48e3-8bc6-ba8cf8056115 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:27.335931 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b899ada-2761-48e3-8bc6-ba8cf8056115 None admin] PATH_INFO: `/v3/system/users/d04aaf68e275463f8333ad36887ebf14/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:27.338127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b899ada-2761-48e3-8bc6-ba8cf8056115 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d04aaf68e275463f8333ad36887ebf14, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:27.339718 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b899ada-2761-48e3-8bc6-ba8cf8056115 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:27.471113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 119/239] 10.222.0.45 () {58 vars in 1334 bytes} [Mon Oct 31 14:47:27 2022] PUT /identity/v3/system/users/d04aaf68e275463f8333ad36887ebf14/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:29.216289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a0cd0-ddf6-4c60-8ecf-ecba9ae24f4b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:29.216795 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36bc4-e76d-46d9-8745-587ebdecc8cd None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:29.217160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a0cd0-ddf6-4c60-8ecf-ecba9ae24f4b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:29.217236 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36bc4-e76d-46d9-8745-587ebdecc8cd None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:29.217330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a0cd0-ddf6-4c60-8ecf-ecba9ae24f4b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:29.217402 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba36bc4-e76d-46d9-8745-587ebdecc8cd None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:29.218309 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 121/240] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:29.218620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 120/241] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:29.223269 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606804d4-d356-40a5-89d9-4250494fe065 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:29.223523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501da50c-c990-4717-8235-57d4d3e976ce None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:29.223623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606804d4-d356-40a5-89d9-4250494fe065 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:29.223802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606804d4-d356-40a5-89d9-4250494fe065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:29.223912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501da50c-c990-4717-8235-57d4d3e976ce None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:29.224067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501da50c-c990-4717-8235-57d4d3e976ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:29.242908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-606804d4-d356-40a5-89d9-4250494fe065 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:29.243635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-501da50c-c990-4717-8235-57d4d3e976ce None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:29.244011 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-606804d4-d356-40a5-89d9-4250494fe065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:29.244808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-501da50c-c990-4717-8235-57d4d3e976ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:29.304167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:29.317408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 121/242] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:29.326979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 122/243] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:29.594438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501da50c-c990-4717-8235-57d4d3e976ce None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:29.596327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606804d4-d356-40a5-89d9-4250494fe065 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:29.672609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:29.696409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501da50c-c990-4717-8235-57d4d3e976ce None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:29.696557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606804d4-d356-40a5-89d9-4250494fe065 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:29.729806 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33647b-01b4-4c1c-8860-644b3705791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:29.730427 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33647b-01b4-4c1c-8860-644b3705791c None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:29.730702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33647b-01b4-4c1c-8860-644b3705791c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:29.730963 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33647b-01b4-4c1c-8860-644b3705791c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:29.732083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32012c9-cffe-47d6-8c57-0c14771e13eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:29.732865 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32012c9-cffe-47d6-8c57-0c14771e13eb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:29.733133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32012c9-cffe-47d6-8c57-0c14771e13eb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:29.733436 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32012c9-cffe-47d6-8c57-0c14771e13eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:29.734527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32012c9-cffe-47d6-8c57-0c14771e13eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:29.735945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32012c9-cffe-47d6-8c57-0c14771e13eb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:29.737663 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 123/244] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:29.738794 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3f294-ade9-4457-b4b4-35e72ddc15a3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:29.739065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3f294-ade9-4457-b4b4-35e72ddc15a3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:29.739329 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3f294-ade9-4457-b4b4-35e72ddc15a3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:29.743994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 124/245] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:29.744127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33647b-01b4-4c1c-8860-644b3705791c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:29.744211 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3f294-ade9-4457-b4b4-35e72ddc15a3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-ca33647b-01b4-4c1c-8860-644b3705791c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:29.746683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:29.747617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:29.748422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:29.748422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:29.748422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:29.748422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:29.748422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:29.748422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:29.748422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:29.748422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:29.748422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:29.748422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:29.748422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:29.748422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:29.748422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 122/246] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:29.753364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dedcd-0fec-47c1-bc92-0afd437dff64 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:29.753644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dedcd-0fec-47c1-bc92-0afd437dff64 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:29.753914 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dedcd-0fec-47c1-bc92-0afd437dff64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:29.772015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-7a9dedcd-0fec-47c1-bc92-0afd437dff64 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:29.773239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7a9dedcd-0fec-47c1-bc92-0afd437dff64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:29.801260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:29.838966 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 123/247] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:29.839787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dedcd-0fec-47c1-bc92-0afd437dff64 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:29.846813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3f294-ade9-4457-b4b4-35e72ddc15a3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:29.889201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08329098-06aa-4b0a-9ff1-8e4aa489d0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:29.890487 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08329098-06aa-4b0a-9ff1-8e4aa489d0ca None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:29.890937 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08329098-06aa-4b0a-9ff1-8e4aa489d0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:29.891373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08329098-06aa-4b0a-9ff1-8e4aa489d0ca None admin] PATH_INFO: `/v3/groups` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:29.892190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08329098-06aa-4b0a-9ff1-8e4aa489d0ca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:29.894642 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08329098-06aa-4b0a-9ff1-8e4aa489d0ca None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:29.906155 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:29.940025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dedcd-0fec-47c1-bc92-0afd437dff64 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:29.972371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b88cb4-26b9-4349-a689-c86f87513ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:29.973073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b88cb4-26b9-4349-a689-c86f87513ddc None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:29.973502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b88cb4-26b9-4349-a689-c86f87513ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:29.976100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b88cb4-26b9-4349-a689-c86f87513ddc None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:29.976100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b88cb4-26b9-4349-a689-c86f87513ddc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:29.976100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b88cb4-26b9-4349-a689-c86f87513ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:29.976332 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b88cb4-26b9-4349-a689-c86f87513ddc None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:29.985986 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 124/248] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:29.991774 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b88cb4-26b9-4349-a689-c86f87513ddc None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:29.998503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 125/249] 10.222.0.45 () {60 vars in 1134 bytes} [Mon Oct 31 14:47:29 2022] POST /identity/v3/groups => generated 226 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:47:30.112681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08329098-06aa-4b0a-9ff1-8e4aa489d0ca None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:30.113664 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b88cb4-26b9-4349-a689-c86f87513ddc None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:30.146257 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:30.157352 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54437d5b-5b75-4f56-a533-52f0ed28b9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:30.158124 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437d5b-5b75-4f56-a533-52f0ed28b9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:30.158401 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437d5b-5b75-4f56-a533-52f0ed28b9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:30.161975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437d5b-5b75-4f56-a533-52f0ed28b9a6 None admin] PATH_INFO: `/v3/users/095af67a695240e7b79796b3d0a18228` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:30.161975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54437d5b-5b75-4f56-a533-52f0ed28b9a6 None admin] RBAC: Authorizing `identity:get_user(user_id=095af67a695240e7b79796b3d0a18228)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:30.161975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54437d5b-5b75-4f56-a533-52f0ed28b9a6 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:30.163233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 125/250] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:29 2022] GET /identity/v3/users/095af67a695240e7b79796b3d0a18228 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:30.169615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54437d5b-5b75-4f56-a533-52f0ed28b9a6 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:30.233959 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08329098-06aa-4b0a-9ff1-8e4aa489d0ca None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:30.252143 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:30.275668 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443f774-75b1-4d55-a317-5a568f669be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:30.276310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443f774-75b1-4d55-a317-5a568f669be1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:30.276576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443f774-75b1-4d55-a317-5a568f669be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:30.277119 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443f774-75b1-4d55-a317-5a568f669be1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:30.288946 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443f774-75b1-4d55-a317-5a568f669be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:30.295263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54437d5b-5b75-4f56-a533-52f0ed28b9a6 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8443f774-75b1-4d55-a317-5a568f669be1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:30.295721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:30.296855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:30.297850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:30.297850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:30.297850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:30.297850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:30.297850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:30.297850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:30.297850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:30.297850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:30.297850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:30.297850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:30.297850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:30.297850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:30.297850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 126/251] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:47:30.302548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443f774-75b1-4d55-a317-5a568f669be1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:30.343471 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecc1b4-8f90-4f3a-b85e-46e782598cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:30.344452 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecc1b4-8f90-4f3a-b85e-46e782598cc4 None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:30.344733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecc1b4-8f90-4f3a-b85e-46e782598cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:30.345005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecc1b4-8f90-4f3a-b85e-46e782598cc4 None admin] PATH_INFO: `/v3/system/users/095af67a695240e7b79796b3d0a18228/roles/2e8a422395c1407e9f923b187fe96450` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:30.346476 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ecc1b4-8f90-4f3a-b85e-46e782598cc4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=095af67a695240e7b79796b3d0a18228, role_id=2e8a422395c1407e9f923b187fe96450)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:30.347863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ecc1b4-8f90-4f3a-b85e-46e782598cc4 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:30.420597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 126/252] 10.222.0.45 () {58 vars in 1334 bytes} [Mon Oct 31 14:47:30 2022] PUT /identity/v3/system/users/095af67a695240e7b79796b3d0a18228/roles/2e8a422395c1407e9f923b187fe96450 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:47:30.422972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443f774-75b1-4d55-a317-5a568f669be1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:30.465572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692fac6-6bc7-47d2-b794-4552b7231f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:30.466501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692fac6-6bc7-47d2-b794-4552b7231f26 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:30.467010 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692fac6-6bc7-47d2-b794-4552b7231f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:30.467483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692fac6-6bc7-47d2-b794-4552b7231f26 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:30.468380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692fac6-6bc7-47d2-b794-4552b7231f26 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:30.468947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692fac6-6bc7-47d2-b794-4552b7231f26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:30.470627 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692fac6-6bc7-47d2-b794-4552b7231f26 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:30.482377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 127/253] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:30.488303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecc1b4-8f90-4f3a-b85e-46e782598cc4 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:30.574595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:30.626004 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecc1b4-8f90-4f3a-b85e-46e782598cc4 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:30.668071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04193965-0d27-400c-b6ae-1665b2ff0031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:30.668719 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04193965-0d27-400c-b6ae-1665b2ff0031 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:30.668999 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04193965-0d27-400c-b6ae-1665b2ff0031 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:30.669272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04193965-0d27-400c-b6ae-1665b2ff0031 None admin] PATH_INFO: `/v3/users/d04aaf68e275463f8333ad36887ebf14` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:30.670469 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04193965-0d27-400c-b6ae-1665b2ff0031 None admin] RBAC: Authorizing `identity:get_user(user_id=d04aaf68e275463f8333ad36887ebf14)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:30.671988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04193965-0d27-400c-b6ae-1665b2ff0031 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:30.673564 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 127/254] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:30 2022] GET /identity/v3/users/d04aaf68e275463f8333ad36887ebf14 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:30.679446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692fac6-6bc7-47d2-b794-4552b7231f26 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:30.723246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:30.788565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692fac6-6bc7-47d2-b794-4552b7231f26 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:30.825947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e02b2c-b67a-44d9-ae7f-a7f0a8bf965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:30.826558 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e02b2c-b67a-44d9-ae7f-a7f0a8bf965e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:30.826833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e02b2c-b67a-44d9-ae7f-a7f0a8bf965e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:30.827103 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e02b2c-b67a-44d9-ae7f-a7f0a8bf965e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:30.827974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e02b2c-b67a-44d9-ae7f-a7f0a8bf965e None admin] RBAC: Adding query filter params (role.id=c3f5b94962604da78f8e1a5d18105768, user.id=d04aaf68e275463f8333ad36887ebf14, scope.system=all) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:30.828281 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e02b2c-b67a-44d9-ae7f-a7f0a8bf965e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:30.829750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e02b2c-b67a-44d9-ae7f-a7f0a8bf965e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:30.842886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 128/255] 10.222.0.45 () {56 vars in 1308 bytes} [Mon Oct 31 14:47:30 2022] GET /identity/v3/role_assignments?user.id=d04aaf68e275463f8333ad36887ebf14&scope.system=all&role.id=c3f5b94962604da78f8e1a5d18105768 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:32.630660 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00622c-2b51-4599-90e2-8d573d56d099 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:32.631167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00622c-2b51-4599-90e2-8d573d56d099 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:32.631241 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00622c-2b51-4599-90e2-8d573d56d099 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:32.632615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 128/256] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:32.638455 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decbafd-3eb0-4b4c-a642-512912a8a4df None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:32.638994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decbafd-3eb0-4b4c-a642-512912a8a4df None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:32.638994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decbafd-3eb0-4b4c-a642-512912a8a4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:32.670358 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7decbafd-3eb0-4b4c-a642-512912a8a4df None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:32.671596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7decbafd-3eb0-4b4c-a642-512912a8a4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:32.728504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a1a2-fe0c-4349-80d3-f38357f41f76 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:32.728829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a1a2-fe0c-4349-80d3-f38357f41f76 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:32.729038 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a1a2-fe0c-4349-80d3-f38357f41f76 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:32.730417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 129/257] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:32.735700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de55f8-c98e-40b8-9882-36ec9d510b50 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:32.735976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de55f8-c98e-40b8-9882-36ec9d510b50 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:32.736248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de55f8-c98e-40b8-9882-36ec9d510b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:32.764272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 129/258] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 14:47:32.765158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-b0de55f8-c98e-40b8-9882-36ec9d510b50 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:32.766394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b0de55f8-c98e-40b8-9882-36ec9d510b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:32.780274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 130/259] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 31 14:47:33.308357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decbafd-3eb0-4b4c-a642-512912a8a4df None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:33.321311 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decbafd-3eb0-4b4c-a642-512912a8a4df None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:33.325956 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a1623-1aab-4c53-9010-7dd1d13a665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:33.326638 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1623-1aab-4c53-9010-7dd1d13a665e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.326917 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1623-1aab-4c53-9010-7dd1d13a665e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.327192 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a1623-1aab-4c53-9010-7dd1d13a665e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.329628 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34eacc-e25b-49a1-b696-a6b882a43059 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.329903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34eacc-e25b-49a1-b696-a6b882a43059 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.330170 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34eacc-e25b-49a1-b696-a6b882a43059 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.331599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 131/260] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:33.336856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88e4b5-66ac-455b-874e-99d7aefb047d None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.337136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88e4b5-66ac-455b-874e-99d7aefb047d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.337435 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88e4b5-66ac-455b-874e-99d7aefb047d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.364662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a1623-1aab-4c53-9010-7dd1d13a665e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-865a1623-1aab-4c53-9010-7dd1d13a665e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:33.370152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:33.371040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:33.371814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:33.371814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:33.371814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:33.371814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:33.371814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:33.371814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:33.371814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:33.371814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:33.371814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:33.371814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:33.371814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:33.371814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:33.372427 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-fd88e4b5-66ac-455b-874e-99d7aefb047d None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:33.373530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-fd88e4b5-66ac-455b-874e-99d7aefb047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:33.375263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 130/261] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Oct 31 14:47:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:33.378386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a1623-1aab-4c53-9010-7dd1d13a665e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:33.397118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a1623-1aab-4c53-9010-7dd1d13a665e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:33.413256 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80502e37-12f3-46f3-9938-c6703b30d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:33.413928 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80502e37-12f3-46f3-9938-c6703b30d731 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.414322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80502e37-12f3-46f3-9938-c6703b30d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.414603 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80502e37-12f3-46f3-9938-c6703b30d731 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.442587 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80502e37-12f3-46f3-9938-c6703b30d731 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-80502e37-12f3-46f3-9938-c6703b30d731 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:33.447734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:33.448601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:33.449395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:33.449395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:33.449395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:33.449395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:33.449395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:33.449395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:33.449395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:33.449395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:33.449395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:33.449395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:33.449395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:33.449395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:33.449395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 131/262] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Oct 31 14:47:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:33.450035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80502e37-12f3-46f3-9938-c6703b30d731 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:33.471092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80502e37-12f3-46f3-9938-c6703b30d731 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:33.484714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 132/263] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:33.485446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88e4b5-66ac-455b-874e-99d7aefb047d None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:33.493978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c0bf0-0efd-4a3e-ba8e-f7916d173308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:33.494607 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c0bf0-0efd-4a3e-ba8e-f7916d173308 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.494886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c0bf0-0efd-4a3e-ba8e-f7916d173308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.495155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c0bf0-0efd-4a3e-ba8e-f7916d173308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.495829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c0bf0-0efd-4a3e-ba8e-f7916d173308 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:33.496126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c0bf0-0efd-4a3e-ba8e-f7916d173308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:33.497200 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88e4b5-66ac-455b-874e-99d7aefb047d None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:33.497933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-477c0bf0-0efd-4a3e-ba8e-f7916d173308 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:47:33.497933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: warnings.warn(msg) Oct 31 14:47:33.497933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: Oct 31 14:47:33.498849 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c0bf0-0efd-4a3e-ba8e-f7916d173308 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:33.502312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d011f-7884-4c8b-b37c-ca7e7255a146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:33.503020 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d011f-7884-4c8b-b37c-ca7e7255a146 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.503392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d011f-7884-4c8b-b37c-ca7e7255a146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.503758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d011f-7884-4c8b-b37c-ca7e7255a146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.504512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d011f-7884-4c8b-b37c-ca7e7255a146 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:33.504911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d011f-7884-4c8b-b37c-ca7e7255a146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:33.506907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: WARNING py.warnings [None req-1f8d011f-7884-4c8b-b37c-ca7e7255a146 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:47:33.506907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: warnings.warn(msg) Oct 31 14:47:33.506907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: Oct 31 14:47:33.507842 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d011f-7884-4c8b-b37c-ca7e7255a146 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:33.511404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 132/264] 10.222.0.45 () {56 vars in 1132 bytes} [Mon Oct 31 14:47:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:33.517090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c0bf0-0efd-4a3e-ba8e-f7916d173308 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:33.521764 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 133/265] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 31 14:47:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:33.528024 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d011f-7884-4c8b-b37c-ca7e7255a146 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:33.539811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c0bf0-0efd-4a3e-ba8e-f7916d173308 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:33.541357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d011f-7884-4c8b-b37c-ca7e7255a146 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:33.547746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391a3bc-3dc3-49a2-8ed8-d138baf78670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:33.548426 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a3bc-3dc3-49a2-8ed8-d138baf78670 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.548708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a3bc-3dc3-49a2-8ed8-d138baf78670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.548981 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391a3bc-3dc3-49a2-8ed8-d138baf78670 admin admin] PATH_INFO: `/v3/groups/2f9ffa16b7d948538d1113b4e4d45073` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.557979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813fe5d-0b5c-45c0-a4f9-efb7697dbf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:33.558164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391a3bc-3dc3-49a2-8ed8-d138baf78670 admin admin] RBAC: Authorizing `identity:get_group(group_id=2f9ffa16b7d948538d1113b4e4d45073)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:33.558678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813fe5d-0b5c-45c0-a4f9-efb7697dbf20 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.558904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813fe5d-0b5c-45c0-a4f9-efb7697dbf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.559173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813fe5d-0b5c-45c0-a4f9-efb7697dbf20 admin admin] PATH_INFO: `/v3/groups/2f9ffa16b7d948538d1113b4e4d45073` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.559270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: WARNING py.warnings [None req-2391a3bc-3dc3-49a2-8ed8-d138baf78670 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:47:33.559270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: warnings.warn(msg) Oct 31 14:47:33.559270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: Oct 31 14:47:33.560361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813fe5d-0b5c-45c0-a4f9-efb7697dbf20 admin admin] RBAC: Authorizing `identity:get_group(group_id=2f9ffa16b7d948538d1113b4e4d45073)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:33.561402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-0813fe5d-0b5c-45c0-a4f9-efb7697dbf20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:47:33.561402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: warnings.warn(msg) Oct 31 14:47:33.561402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: Oct 31 14:47:33.562505 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391a3bc-3dc3-49a2-8ed8-d138baf78670 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:33.562625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813fe5d-0b5c-45c0-a4f9-efb7697dbf20 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:33.564156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 133/266] 10.222.0.45 () {56 vars in 1201 bytes} [Mon Oct 31 14:47:33 2022] GET /identity/v3/groups/2f9ffa16b7d948538d1113b4e4d45073 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:33.564790 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 134/267] 10.222.0.45 () {56 vars in 1201 bytes} [Mon Oct 31 14:47:33 2022] GET /identity/v3/groups/2f9ffa16b7d948538d1113b4e4d45073 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:33.569686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813fe5d-0b5c-45c0-a4f9-efb7697dbf20 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:33.571148 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391a3bc-3dc3-49a2-8ed8-d138baf78670 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:33.582756 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391a3bc-3dc3-49a2-8ed8-d138baf78670 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:33.584159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:33.587671 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813fe5d-0b5c-45c0-a4f9-efb7697dbf20 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:33.588106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233b0c8-d3dc-4c6a-b27e-b089134781bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:33.588933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233b0c8-d3dc-4c6a-b27e-b089134781bb admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.589477 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233b0c8-d3dc-4c6a-b27e-b089134781bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.613312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233b0c8-d3dc-4c6a-b27e-b089134781bb admin admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.613312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233b0c8-d3dc-4c6a-b27e-b089134781bb admin admin] RBAC: Authorizing `identity:get_project(project_id=86030394acc448f88cf92161d1688d4d)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:33.613312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233b0c8-d3dc-4c6a-b27e-b089134781bb admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:33.613312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 135/268] 10.222.0.45 () {56 vars in 1207 bytes} [Mon Oct 31 14:47:33 2022] GET /identity/v3/projects/86030394acc448f88cf92161d1688d4d => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:33.613595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c11acd-c59a-49ba-8a0c-08af8e48dceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:33.613595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c11acd-c59a-49ba-8a0c-08af8e48dceb admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.613595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c11acd-c59a-49ba-8a0c-08af8e48dceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.613595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c11acd-c59a-49ba-8a0c-08af8e48dceb admin admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.613856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233b0c8-d3dc-4c6a-b27e-b089134781bb admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:33.613930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c11acd-c59a-49ba-8a0c-08af8e48dceb admin admin] RBAC: Authorizing `identity:get_project(project_id=86030394acc448f88cf92161d1688d4d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:33.613930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c11acd-c59a-49ba-8a0c-08af8e48dceb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:33.613930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 134/269] 10.222.0.45 () {56 vars in 1207 bytes} [Mon Oct 31 14:47:33 2022] GET /identity/v3/projects/86030394acc448f88cf92161d1688d4d => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:33.616633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233b0c8-d3dc-4c6a-b27e-b089134781bb admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:33.620172 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c11acd-c59a-49ba-8a0c-08af8e48dceb admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:33.622536 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88176ea0-7abf-4c85-8384-35a3f5a2df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:33.623308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88176ea0-7abf-4c85-8384-35a3f5a2df47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.623659 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88176ea0-7abf-4c85-8384-35a3f5a2df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.623872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88176ea0-7abf-4c85-8384-35a3f5a2df47 admin admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d/groups/2f9ffa16b7d948538d1113b4e4d45073/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.626059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88176ea0-7abf-4c85-8384-35a3f5a2df47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86030394acc448f88cf92161d1688d4d, group_id=2f9ffa16b7d948538d1113b4e4d45073, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:33.627148 dv-cinder-860227-3-smb devstack@keystone.service[81684]: WARNING py.warnings [None req-88176ea0-7abf-4c85-8384-35a3f5a2df47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:47:33.627148 dv-cinder-860227-3-smb devstack@keystone.service[81684]: warnings.warn(msg) Oct 31 14:47:33.627148 dv-cinder-860227-3-smb devstack@keystone.service[81684]: Oct 31 14:47:33.629266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88176ea0-7abf-4c85-8384-35a3f5a2df47 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:33.639027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c11acd-c59a-49ba-8a0c-08af8e48dceb admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:33.650209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339926d-f4ab-4d37-9a80-99aa6777e5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:33.651109 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339926d-f4ab-4d37-9a80-99aa6777e5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.651645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339926d-f4ab-4d37-9a80-99aa6777e5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.652058 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339926d-f4ab-4d37-9a80-99aa6777e5b0 admin admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d/groups/2f9ffa16b7d948538d1113b4e4d45073/roles/80aa63d20ae84a66991d542b3ed87f66` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.657951 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339926d-f4ab-4d37-9a80-99aa6777e5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86030394acc448f88cf92161d1688d4d, group_id=2f9ffa16b7d948538d1113b4e4d45073, role_id=80aa63d20ae84a66991d542b3ed87f66)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:33.658974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-0339926d-f4ab-4d37-9a80-99aa6777e5b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 14:47:33.658974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: warnings.warn(msg) Oct 31 14:47:33.658974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: Oct 31 14:47:33.660891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339926d-f4ab-4d37-9a80-99aa6777e5b0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:33.717116 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 136/270] 10.222.0.45 () {58 vars in 1463 bytes} [Mon Oct 31 14:47:33 2022] PUT /identity/v3/projects/86030394acc448f88cf92161d1688d4d/groups/2f9ffa16b7d948538d1113b4e4d45073/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:33.719104 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250981c-bf9b-463d-bca8-48781e52d3de None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.719581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250981c-bf9b-463d-bca8-48781e52d3de None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.719989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250981c-bf9b-463d-bca8-48781e52d3de None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.721463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 137/271] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:33.727222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0130-4efa-477b-9fca-6119d5bf8473 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:33.727834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0130-4efa-477b-9fca-6119d5bf8473 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:33.728271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db0130-4efa-477b-9fca-6119d5bf8473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:33.753605 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 135/272] 10.222.0.45 () {58 vars in 1463 bytes} [Mon Oct 31 14:47:33 2022] PUT /identity/v3/projects/86030394acc448f88cf92161d1688d4d/groups/2f9ffa16b7d948538d1113b4e4d45073/roles/80aa63d20ae84a66991d542b3ed87f66 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:47:33.755020 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f3db0130-4efa-477b-9fca-6119d5bf8473 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:33.756496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f3db0130-4efa-477b-9fca-6119d5bf8473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:33.777823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:33.843644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 138/273] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 31 14:47:34.010962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339926d-f4ab-4d37-9a80-99aa6777e5b0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:34.132061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339926d-f4ab-4d37-9a80-99aa6777e5b0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:34.162725 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0130-4efa-477b-9fca-6119d5bf8473 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:34.179128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db0130-4efa-477b-9fca-6119d5bf8473 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:34.180486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94027041-a178-4ab2-b0e0-cf8859fae87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:34.181134 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94027041-a178-4ab2-b0e0-cf8859fae87b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:34.181458 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94027041-a178-4ab2-b0e0-cf8859fae87b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:34.181732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94027041-a178-4ab2-b0e0-cf8859fae87b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:34.186616 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846012a-007d-431c-89d6-1aa8101b62a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:34.187734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846012a-007d-431c-89d6-1aa8101b62a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:34.188210 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846012a-007d-431c-89d6-1aa8101b62a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:34.188671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846012a-007d-431c-89d6-1aa8101b62a9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:34.201906 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846012a-007d-431c-89d6-1aa8101b62a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:34.204330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94027041-a178-4ab2-b0e0-cf8859fae87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-d846012a-007d-431c-89d6-1aa8101b62a9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:34.207609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:34.208438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:34.209212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:34.209212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:34.209212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:34.209212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:34.209212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:34.209212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:34.209212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:34.209212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:34.209212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:34.209212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:34.209212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:34.209212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-94027041-a178-4ab2-b0e0-cf8859fae87b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:34.210244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:34.211584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:34.212995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:34.212995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:34.212995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:34.212995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:34.212995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:34.212995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:34.212995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:34.212995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:34.212995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:34.212995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:34.212995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 31 14:47:34.212995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:34.212995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 136/274] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:34.215933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 139/275] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Oct 31 14:47:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:47:34.217217 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94027041-a178-4ab2-b0e0-cf8859fae87b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:34.225339 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846012a-007d-431c-89d6-1aa8101b62a9 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:34.240287 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846012a-007d-431c-89d6-1aa8101b62a9 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:34.247282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e2b33-7e47-4ff8-b2e5-0143d65d9f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:34.248279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2b33-7e47-4ff8-b2e5-0143d65d9f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:34.248780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2b33-7e47-4ff8-b2e5-0143d65d9f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:34.249238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e2b33-7e47-4ff8-b2e5-0143d65d9f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:34.250216 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e2b33-7e47-4ff8-b2e5-0143d65d9f96 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:34.250725 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e2b33-7e47-4ff8-b2e5-0143d65d9f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:34.252597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e2b33-7e47-4ff8-b2e5-0143d65d9f96 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:34.267039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 140/276] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 31 14:47:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:34.280219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e2b33-7e47-4ff8-b2e5-0143d65d9f96 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:34.297679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e2b33-7e47-4ff8-b2e5-0143d65d9f96 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:34.307670 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fc8d7-dfde-45fb-8832-09b848036222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:34.308826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fc8d7-dfde-45fb-8832-09b848036222 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:34.309316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fc8d7-dfde-45fb-8832-09b848036222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:34.309814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fc8d7-dfde-45fb-8832-09b848036222 admin admin] PATH_INFO: `/v3/groups/2f9ffa16b7d948538d1113b4e4d45073` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:34.311199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fc8d7-dfde-45fb-8832-09b848036222 admin admin] RBAC: Authorizing `identity:get_group(group_id=2f9ffa16b7d948538d1113b4e4d45073)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:34.313569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fc8d7-dfde-45fb-8832-09b848036222 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:34.318966 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 141/277] 10.222.0.45 () {56 vars in 1201 bytes} [Mon Oct 31 14:47:34 2022] GET /identity/v3/groups/2f9ffa16b7d948538d1113b4e4d45073 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:34.322797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:34.334606 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fc8d7-dfde-45fb-8832-09b848036222 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:34.352812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fc8d7-dfde-45fb-8832-09b848036222 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:34.359457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fb229-609e-4dbf-98b4-83fbf7f29fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:34.360401 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fb229-609e-4dbf-98b4-83fbf7f29fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:34.360971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fb229-609e-4dbf-98b4-83fbf7f29fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:34.362737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fb229-609e-4dbf-98b4-83fbf7f29fc1 admin admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:34.364227 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fb229-609e-4dbf-98b4-83fbf7f29fc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=b4b4cae986dd47d99c03d6174a8a464a)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:34.366840 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fb229-609e-4dbf-98b4-83fbf7f29fc1 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:34.372180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 142/278] 10.222.0.45 () {56 vars in 1207 bytes} [Mon Oct 31 14:47:34 2022] GET /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:34.387811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fb229-609e-4dbf-98b4-83fbf7f29fc1 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:34.397935 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fb229-609e-4dbf-98b4-83fbf7f29fc1 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:34.410713 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100f4b3-78f5-4c80-8415-97cecc427219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:34.411365 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f4b3-78f5-4c80-8415-97cecc427219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:34.411644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f4b3-78f5-4c80-8415-97cecc427219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:34.411914 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f4b3-78f5-4c80-8415-97cecc427219 admin admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a/groups/2f9ffa16b7d948538d1113b4e4d45073/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:34.415419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100f4b3-78f5-4c80-8415-97cecc427219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b4cae986dd47d99c03d6174a8a464a, group_id=2f9ffa16b7d948538d1113b4e4d45073, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:34.418099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100f4b3-78f5-4c80-8415-97cecc427219 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:34.435308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94027041-a178-4ab2-b0e0-cf8859fae87b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:34.485113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943bc91-bff4-4bf6-b050-f0f942099295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:34.485757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943bc91-bff4-4bf6-b050-f0f942099295 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:34.486037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943bc91-bff4-4bf6-b050-f0f942099295 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:34.486311 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943bc91-bff4-4bf6-b050-f0f942099295 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:34.486979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943bc91-bff4-4bf6-b050-f0f942099295 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:34.487283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943bc91-bff4-4bf6-b050-f0f942099295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:34.488655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943bc91-bff4-4bf6-b050-f0f942099295 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:34.501023 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 137/279] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:34.506537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943bc91-bff4-4bf6-b050-f0f942099295 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:34.526414 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 143/280] 10.222.0.45 () {58 vars in 1463 bytes} [Mon Oct 31 14:47:34 2022] PUT /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a/groups/2f9ffa16b7d948538d1113b4e4d45073/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:47:34.651787 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943bc91-bff4-4bf6-b050-f0f942099295 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:34.668154 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:34.693415 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106189e3-7be4-4b9f-9ddb-028dd054f1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:34.694071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106189e3-7be4-4b9f-9ddb-028dd054f1da None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:34.694349 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106189e3-7be4-4b9f-9ddb-028dd054f1da None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:34.694619 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106189e3-7be4-4b9f-9ddb-028dd054f1da None admin] PATH_INFO: `/v3/users/095af67a695240e7b79796b3d0a18228` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:34.702262 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106189e3-7be4-4b9f-9ddb-028dd054f1da None admin] RBAC: Authorizing `identity:get_user(user_id=095af67a695240e7b79796b3d0a18228)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:34.703746 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106189e3-7be4-4b9f-9ddb-028dd054f1da None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:34.706110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 138/281] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:47:34 2022] GET /identity/v3/users/095af67a695240e7b79796b3d0a18228 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:34.711632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100f4b3-78f5-4c80-8415-97cecc427219 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:34.828678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100f4b3-78f5-4c80-8415-97cecc427219 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:34.852797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:34.869898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffea68-26fd-4f3d-82b0-d6ea2e9d0d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:34.869898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffea68-26fd-4f3d-82b0-d6ea2e9d0d26 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:34.869898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffea68-26fd-4f3d-82b0-d6ea2e9d0d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:34.869898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffea68-26fd-4f3d-82b0-d6ea2e9d0d26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:34.870520 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffea68-26fd-4f3d-82b0-d6ea2e9d0d26 None admin] RBAC: Adding query filter params (role.id=2e8a422395c1407e9f923b187fe96450, user.id=095af67a695240e7b79796b3d0a18228, scope.system=all) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:34.870832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffea68-26fd-4f3d-82b0-d6ea2e9d0d26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:34.872268 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffea68-26fd-4f3d-82b0-d6ea2e9d0d26 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:34.893362 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 144/282] 10.222.0.45 () {56 vars in 1308 bytes} [Mon Oct 31 14:47:34 2022] GET /identity/v3/role_assignments?user.id=095af67a695240e7b79796b3d0a18228&scope.system=all&role.id=2e8a422395c1407e9f923b187fe96450 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:35.183405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcb188-05b9-43d9-82b3-3ed1b1018b91 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:35.183774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcb188-05b9-43d9-82b3-3ed1b1018b91 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:35.183952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcb188-05b9-43d9-82b3-3ed1b1018b91 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:35.185774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 139/283] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:35.193843 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac2835-110d-48a0-8ec2-08e42712a2c4 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:35.193843 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac2835-110d-48a0-8ec2-08e42712a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:35.193843 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac2835-110d-48a0-8ec2-08e42712a2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:35.218490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-5fac2835-110d-48a0-8ec2-08e42712a2c4 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:35.219746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5fac2835-110d-48a0-8ec2-08e42712a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:35.302837 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 145/284] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 14:47:35.347370 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c98e5f-0d48-4db6-973b-a96aa463bec6 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:35.347697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c98e5f-0d48-4db6-973b-a96aa463bec6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:35.347919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c98e5f-0d48-4db6-973b-a96aa463bec6 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:35.349646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 140/285] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:35.356060 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45cc2-f3a0-4110-8a97-220ec8abd9af None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:35.356368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45cc2-f3a0-4110-8a97-220ec8abd9af None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:35.356613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45cc2-f3a0-4110-8a97-220ec8abd9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:35.385081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-b2d45cc2-f3a0-4110-8a97-220ec8abd9af None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:35.386320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b2d45cc2-f3a0-4110-8a97-220ec8abd9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:35.394221 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 146/286] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 31 14:47:35.649469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c98e5f-0d48-4db6-973b-a96aa463bec6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:35.667408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c98e5f-0d48-4db6-973b-a96aa463bec6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:35.671871 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3678161-9c15-493d-af6d-5f5073ae5cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:35.672494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678161-9c15-493d-af6d-5f5073ae5cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:35.672772 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678161-9c15-493d-af6d-5f5073ae5cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:35.673049 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678161-9c15-493d-af6d-5f5073ae5cc2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:35.694277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3678161-9c15-493d-af6d-5f5073ae5cc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d3678161-9c15-493d-af6d-5f5073ae5cc2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:35.699346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:35.700245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:35.701056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:35.701056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:35.701056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:35.701056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:35.701056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:35.701056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:35.701056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:35.701056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:35.701056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:35.701056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:35.701056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:35.701056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:35.701056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 141/287] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Oct 31 14:47:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:35.706367 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d45cc2-f3a0-4110-8a97-220ec8abd9af None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:35.720345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d45cc2-f3a0-4110-8a97-220ec8abd9af None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:35.728694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cb56d-34bc-4dee-a150-3406b2ab1c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:35.729323 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cb56d-34bc-4dee-a150-3406b2ab1c42 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:35.729611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cb56d-34bc-4dee-a150-3406b2ab1c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:35.729880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cb56d-34bc-4dee-a150-3406b2ab1c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:35.730550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cb56d-34bc-4dee-a150-3406b2ab1c42 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:35.730850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cb56d-34bc-4dee-a150-3406b2ab1c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:35.732470 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cb56d-34bc-4dee-a150-3406b2ab1c42 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:35.748483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 147/288] 10.222.0.45 () {56 vars in 1132 bytes} [Mon Oct 31 14:47:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:35.754195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3678161-9c15-493d-af6d-5f5073ae5cc2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:35.770506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3678161-9c15-493d-af6d-5f5073ae5cc2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:35.782435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee68f2b-228b-4167-ae4b-5edb6d095825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:35.783073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68f2b-228b-4167-ae4b-5edb6d095825 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:35.783352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68f2b-228b-4167-ae4b-5edb6d095825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:35.783622 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68f2b-228b-4167-ae4b-5edb6d095825 admin admin] PATH_INFO: `/v3/groups/2f9ffa16b7d948538d1113b4e4d45073` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:35.790410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee68f2b-228b-4167-ae4b-5edb6d095825 admin admin] RBAC: Authorizing `identity:get_group(group_id=2f9ffa16b7d948538d1113b4e4d45073)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:35.792387 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee68f2b-228b-4167-ae4b-5edb6d095825 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:35.794020 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 142/289] 10.222.0.45 () {56 vars in 1201 bytes} [Mon Oct 31 14:47:35 2022] GET /identity/v3/groups/2f9ffa16b7d948538d1113b4e4d45073 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:35.799712 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cb56d-34bc-4dee-a150-3406b2ab1c42 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:35.814366 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cb56d-34bc-4dee-a150-3406b2ab1c42 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:35.821116 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3358e-b263-4848-986d-ccda6fc116ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:35.821782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3358e-b263-4848-986d-ccda6fc116ef admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:35.822065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3358e-b263-4848-986d-ccda6fc116ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:35.822384 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3358e-b263-4848-986d-ccda6fc116ef admin admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:35.823570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3358e-b263-4848-986d-ccda6fc116ef admin admin] RBAC: Authorizing `identity:get_project(project_id=b4b4cae986dd47d99c03d6174a8a464a)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:35.825716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3358e-b263-4848-986d-ccda6fc116ef admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:35.827769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 148/290] 10.222.0.45 () {56 vars in 1207 bytes} [Mon Oct 31 14:47:35 2022] GET /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:35.833486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee68f2b-228b-4167-ae4b-5edb6d095825 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:35.836983 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3358e-b263-4848-986d-ccda6fc116ef admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:35.849783 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee68f2b-228b-4167-ae4b-5edb6d095825 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:35.850848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3358e-b263-4848-986d-ccda6fc116ef admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:35.856926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07af986-948f-4f6d-ab60-444e695182d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:35.857592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07af986-948f-4f6d-ab60-444e695182d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:35.857971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07af986-948f-4f6d-ab60-444e695182d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:35.858242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07af986-948f-4f6d-ab60-444e695182d6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:35.861985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811799f-4c8c-41c7-a857-cdd4c458cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:35.862667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811799f-4c8c-41c7-a857-cdd4c458cf82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:35.862943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811799f-4c8c-41c7-a857-cdd4c458cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:35.863310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811799f-4c8c-41c7-a857-cdd4c458cf82 admin admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a/groups/2f9ffa16b7d948538d1113b4e4d45073/roles/80aa63d20ae84a66991d542b3ed87f66` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:35.865554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811799f-4c8c-41c7-a857-cdd4c458cf82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b4cae986dd47d99c03d6174a8a464a, group_id=2f9ffa16b7d948538d1113b4e4d45073, role_id=80aa63d20ae84a66991d542b3ed87f66)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:35.868739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811799f-4c8c-41c7-a857-cdd4c458cf82 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:35.874988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07af986-948f-4f6d-ab60-444e695182d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-e07af986-948f-4f6d-ab60-444e695182d6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:35.880929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:35.887908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:35.889911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:35.889911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:35.889911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:35.889911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:35.889911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:35.889911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:35.889911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:35.889911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:35.889911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:35.889911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:35.889911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:47:35.889911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:35.889911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 149/291] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 31 14:47:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:47:35.891701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07af986-948f-4f6d-ab60-444e695182d6 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:35.905704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07af986-948f-4f6d-ab60-444e695182d6 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:35.912752 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b684906-2398-41a0-b858-8a8adfdbf860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:35.913831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b684906-2398-41a0-b858-8a8adfdbf860 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:35.913831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b684906-2398-41a0-b858-8a8adfdbf860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:35.914533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b684906-2398-41a0-b858-8a8adfdbf860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:35.915781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b684906-2398-41a0-b858-8a8adfdbf860 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:35.916351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b684906-2398-41a0-b858-8a8adfdbf860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:35.918322 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b684906-2398-41a0-b858-8a8adfdbf860 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:35.931439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 150/292] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Oct 31 14:47:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:35.937015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b684906-2398-41a0-b858-8a8adfdbf860 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:35.948977 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b684906-2398-41a0-b858-8a8adfdbf860 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:35.954101 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e83410-f52c-462f-a287-efc199bd6c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:35.955405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e83410-f52c-462f-a287-efc199bd6c4d admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:35.955885 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e83410-f52c-462f-a287-efc199bd6c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:35.956418 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e83410-f52c-462f-a287-efc199bd6c4d admin admin] PATH_INFO: `/v3/groups/8b3ee3d921294536b1967910269955dc` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:35.963679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e83410-f52c-462f-a287-efc199bd6c4d admin admin] RBAC: Authorizing `identity:get_group(group_id=8b3ee3d921294536b1967910269955dc)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:35.966383 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e83410-f52c-462f-a287-efc199bd6c4d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:35.968343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 151/293] 10.222.0.45 () {56 vars in 1201 bytes} [Mon Oct 31 14:47:35 2022] GET /identity/v3/groups/8b3ee3d921294536b1967910269955dc => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:35.974766 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e83410-f52c-462f-a287-efc199bd6c4d admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:35.991972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e83410-f52c-462f-a287-efc199bd6c4d admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:35.997753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0131e-e3f6-413d-93b4-cb004c423d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:35.998727 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0131e-e3f6-413d-93b4-cb004c423d60 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:35.999201 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0131e-e3f6-413d-93b4-cb004c423d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:35.999738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0131e-e3f6-413d-93b4-cb004c423d60 admin admin] PATH_INFO: `/v3/projects/e4bc3597085f4d879b8fe33c50ed5ee8` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:36.001392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0131e-e3f6-413d-93b4-cb004c423d60 admin admin] RBAC: Authorizing `identity:get_project(project_id=e4bc3597085f4d879b8fe33c50ed5ee8)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:36.005399 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0131e-e3f6-413d-93b4-cb004c423d60 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:36.006338 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 152/294] 10.222.0.45 () {56 vars in 1207 bytes} [Mon Oct 31 14:47:35 2022] GET /identity/v3/projects/e4bc3597085f4d879b8fe33c50ed5ee8 => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:36.013053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0131e-e3f6-413d-93b4-cb004c423d60 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:36.015680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 143/295] 10.222.0.45 () {58 vars in 1463 bytes} [Mon Oct 31 14:47:35 2022] PUT /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a/groups/2f9ffa16b7d948538d1113b4e4d45073/roles/80aa63d20ae84a66991d542b3ed87f66 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:36.024727 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0131e-e3f6-413d-93b4-cb004c423d60 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:36.098352 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33516e89-8860-44b2-bc39-cc0bc73b89ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:36.099374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33516e89-8860-44b2-bc39-cc0bc73b89ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:36.099980 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33516e89-8860-44b2-bc39-cc0bc73b89ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:36.100451 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33516e89-8860-44b2-bc39-cc0bc73b89ea admin admin] PATH_INFO: `/v3/projects/e4bc3597085f4d879b8fe33c50ed5ee8/groups/8b3ee3d921294536b1967910269955dc/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:36.104621 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33516e89-8860-44b2-bc39-cc0bc73b89ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4bc3597085f4d879b8fe33c50ed5ee8, group_id=8b3ee3d921294536b1967910269955dc, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:36.107626 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33516e89-8860-44b2-bc39-cc0bc73b89ea admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:36.180620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 153/296] 10.222.0.45 () {58 vars in 1463 bytes} [Mon Oct 31 14:47:36 2022] PUT /identity/v3/projects/e4bc3597085f4d879b8fe33c50ed5ee8/groups/8b3ee3d921294536b1967910269955dc/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:36.889679 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68029f-9687-4250-bd0e-3f6ab7001970 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:36.890233 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68029f-9687-4250-bd0e-3f6ab7001970 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:36.890233 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68029f-9687-4250-bd0e-3f6ab7001970 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:36.891553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 144/297] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:36.897550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa04a2e-1a05-4de7-8846-348663e75f8c None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:36.898874 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa04a2e-1a05-4de7-8846-348663e75f8c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:36.899539 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa04a2e-1a05-4de7-8846-348663e75f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:36.927532 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-caa04a2e-1a05-4de7-8846-348663e75f8c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:36.929067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-caa04a2e-1a05-4de7-8846-348663e75f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:36.937942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:37.027941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 154/298] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:37.099773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc45df7-26e7-498a-9819-474f4b49a784 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:37.100066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc45df7-26e7-498a-9819-474f4b49a784 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:37.100480 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc45df7-26e7-498a-9819-474f4b49a784 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:37.102271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 145/299] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:37.107722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c8669-73d8-4604-8dea-799a2ac9ca14 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:37.108005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c8669-73d8-4604-8dea-799a2ac9ca14 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:37.108278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c8669-73d8-4604-8dea-799a2ac9ca14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:37.127604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-912c8669-73d8-4604-8dea-799a2ac9ca14 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:37.128792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-912c8669-73d8-4604-8dea-799a2ac9ca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:37.202692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 155/300] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:37.482859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc45df7-26e7-498a-9819-474f4b49a784 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:37.587794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c8669-73d8-4604-8dea-799a2ac9ca14 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:37.595962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc45df7-26e7-498a-9819-474f4b49a784 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:37.637002 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfe533-e693-4c91-bde7-cdf9e51d6f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:37.639716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfe533-e693-4c91-bde7-cdf9e51d6f96 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:37.639716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfe533-e693-4c91-bde7-cdf9e51d6f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:37.639716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfe533-e693-4c91-bde7-cdf9e51d6f96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:37.652466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfe533-e693-4c91-bde7-cdf9e51d6f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-57bfe533-e693-4c91-bde7-cdf9e51d6f96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:37.660148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:37.661040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:37.661881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:37.661881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:37.661881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:37.661881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:37.661881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:37.661881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:37.661881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:37.661881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:37.661881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:37.661881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:37.661881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:37.661881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:37.664718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 146/301] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:37.669248 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfe533-e693-4c91-bde7-cdf9e51d6f96 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:37.688852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:37.721915 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:37.763572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c8669-73d8-4604-8dea-799a2ac9ca14 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:37.815221 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6abe3-127f-41d6-8c96-94ea8dd1bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:37.817317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6abe3-127f-41d6-8c96-94ea8dd1bdad None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:37.817317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6abe3-127f-41d6-8c96-94ea8dd1bdad None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:37.817317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6abe3-127f-41d6-8c96-94ea8dd1bdad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:37.830869 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6abe3-127f-41d6-8c96-94ea8dd1bdad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-60d6abe3-127f-41d6-8c96-94ea8dd1bdad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:37.836960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:37.837893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:37.838685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:37.838685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:37.838685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:37.838685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:37.838685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:37.838685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:37.838685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:37.838685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:37.838685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:37.838685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:37.838685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:37.838685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:37.838685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 156/302] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:47:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:37.844433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6abe3-127f-41d6-8c96-94ea8dd1bdad None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:37.884089 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfe533-e693-4c91-bde7-cdf9e51d6f96 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:37.967813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6abe3-127f-41d6-8c96-94ea8dd1bdad None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:37.994035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb5e80-1e2e-49e8-9fd2-fc3f8635563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:37.995330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5e80-1e2e-49e8-9fd2-fc3f8635563f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:37.995805 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5e80-1e2e-49e8-9fd2-fc3f8635563f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:37.996268 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5e80-1e2e-49e8-9fd2-fc3f8635563f None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:37.997140 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb5e80-1e2e-49e8-9fd2-fc3f8635563f None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:37.997681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb5e80-1e2e-49e8-9fd2-fc3f8635563f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:37.999283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb5e80-1e2e-49e8-9fd2-fc3f8635563f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:38.010906 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:38.013020 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 147/303] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:38.024160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb5e80-1e2e-49e8-9fd2-fc3f8635563f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:38.026180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cada1-56b5-49c0-8e87-1046a7ca2446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:38.027274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cada1-56b5-49c0-8e87-1046a7ca2446 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:38.027760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cada1-56b5-49c0-8e87-1046a7ca2446 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:38.028233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cada1-56b5-49c0-8e87-1046a7ca2446 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:38.029210 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cada1-56b5-49c0-8e87-1046a7ca2446 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:38.030991 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cada1-56b5-49c0-8e87-1046a7ca2446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:38.036965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cada1-56b5-49c0-8e87-1046a7ca2446 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:38.056251 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 157/304] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:38.057574 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8cad9-3147-4cea-b597-46da7898b5d1 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:38.057858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8cad9-3147-4cea-b597-46da7898b5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:38.058189 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8cad9-3147-4cea-b597-46da7898b5d1 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:38.059543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 158/305] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:38.065120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8cad9-3147-4cea-b597-46da7898b5d1 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:38.131289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:38.176028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb5e80-1e2e-49e8-9fd2-fc3f8635563f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:38.191343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8cad9-3147-4cea-b597-46da7898b5d1 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:38.220108 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d1d5a-1f70-4bb7-9d91-8f95c806f2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:38.220833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d1d5a-1f70-4bb7-9d91-8f95c806f2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:38.221177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d1d5a-1f70-4bb7-9d91-8f95c806f2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:38.221540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d1d5a-1f70-4bb7-9d91-8f95c806f2d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:38.239928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f9c09-32bc-434a-97cf-bc3839edd99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:38.241113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f9c09-32bc-434a-97cf-bc3839edd99f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:38.241602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f9c09-32bc-434a-97cf-bc3839edd99f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:38.242410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f9c09-32bc-434a-97cf-bc3839edd99f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:38.303094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d1d5a-1f70-4bb7-9d91-8f95c806f2d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:38.304702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d1d5a-1f70-4bb7-9d91-8f95c806f2d4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:38.330264 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:38.340698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f9c09-32bc-434a-97cf-bc3839edd99f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:38.343073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f9c09-32bc-434a-97cf-bc3839edd99f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:38.393646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:38.437962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 148/306] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:38.439384 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c4bf2-abad-4a67-acc8-184534bcf04c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:38.439775 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c4bf2-abad-4a67-acc8-184534bcf04c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:38.444380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c4bf2-abad-4a67-acc8-184534bcf04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:38.463162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e44c4bf2-abad-4a67-acc8-184534bcf04c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:38.463162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e44c4bf2-abad-4a67-acc8-184534bcf04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:38.474321 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 159/307] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 14:47:38.475521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f9c09-32bc-434a-97cf-bc3839edd99f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:38.564902 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 149/308] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:38.566281 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c4bf2-abad-4a67-acc8-184534bcf04c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:38.637641 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:38.659394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f9c09-32bc-434a-97cf-bc3839edd99f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:38.699300 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c4bf2-abad-4a67-acc8-184534bcf04c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:38.701410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:38.721862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e052aee-c257-45d7-94c0-17d6f8e15931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:38.722740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052aee-c257-45d7-94c0-17d6f8e15931 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:38.723178 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052aee-c257-45d7-94c0-17d6f8e15931 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:38.723594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e052aee-c257-45d7-94c0-17d6f8e15931 None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:38.725747 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e052aee-c257-45d7-94c0-17d6f8e15931 None admin] RBAC: Authorizing `identity:get_project(project_id=86030394acc448f88cf92161d1688d4d)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:38.729128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e052aee-c257-45d7-94c0-17d6f8e15931 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:38.735528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 160/309] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:38 2022] GET /identity/v3/projects/86030394acc448f88cf92161d1688d4d => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:38.737623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e052aee-c257-45d7-94c0-17d6f8e15931 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:38.762696 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e206a-f2cf-45fe-a486-b020c17497e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:38.763600 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e206a-f2cf-45fe-a486-b020c17497e2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:38.764019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e206a-f2cf-45fe-a486-b020c17497e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:38.764439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e206a-f2cf-45fe-a486-b020c17497e2 None admin] PATH_INFO: `/v3/projects/86030394acc448f88cf92161d1688d4d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:38.766634 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e206a-f2cf-45fe-a486-b020c17497e2 None admin] RBAC: Authorizing `identity:get_project(project_id=86030394acc448f88cf92161d1688d4d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:38.768227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e206a-f2cf-45fe-a486-b020c17497e2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:38.771615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 150/310] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:38 2022] GET /identity/v3/projects/86030394acc448f88cf92161d1688d4d => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:38.777947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e206a-f2cf-45fe-a486-b020c17497e2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:38.899277 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e052aee-c257-45d7-94c0-17d6f8e15931 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:38.933547 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e206a-f2cf-45fe-a486-b020c17497e2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:38.942070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554a27a-9e34-485d-a098-247201e15554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:38.942878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554a27a-9e34-485d-a098-247201e15554 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:38.943248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554a27a-9e34-485d-a098-247201e15554 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:38.943611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554a27a-9e34-485d-a098-247201e15554 None admin] PATH_INFO: `/v3/groups/2f9ffa16b7d948538d1113b4e4d45073` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:38.944833 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554a27a-9e34-485d-a098-247201e15554 None admin] RBAC: Authorizing `identity:get_group(group_id=2f9ffa16b7d948538d1113b4e4d45073)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:38.947307 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554a27a-9e34-485d-a098-247201e15554 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:38.949603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 161/311] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 31 14:47:38 2022] GET /identity/v3/groups/2f9ffa16b7d948538d1113b4e4d45073 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:38.954881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554a27a-9e34-485d-a098-247201e15554 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:38.980625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca804ba-59d1-4ecd-8748-5c336a411983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:38.981472 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca804ba-59d1-4ecd-8748-5c336a411983 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:38.981891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca804ba-59d1-4ecd-8748-5c336a411983 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:38.982252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca804ba-59d1-4ecd-8748-5c336a411983 None admin] PATH_INFO: `/v3/groups/2f9ffa16b7d948538d1113b4e4d45073` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:38.983543 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca804ba-59d1-4ecd-8748-5c336a411983 None admin] RBAC: Authorizing `identity:get_group(group_id=2f9ffa16b7d948538d1113b4e4d45073)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:38.985342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca804ba-59d1-4ecd-8748-5c336a411983 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:38.987270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 151/312] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 31 14:47:38 2022] GET /identity/v3/groups/2f9ffa16b7d948538d1113b4e4d45073 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:38.993890 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c3aeb-f4ac-40fe-8e89-82442136bfc5 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:38.995103 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c3aeb-f4ac-40fe-8e89-82442136bfc5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:38.995940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c3aeb-f4ac-40fe-8e89-82442136bfc5 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:38.998835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 152/313] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:39.000609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c3aeb-f4ac-40fe-8e89-82442136bfc5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:39.005409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:39.049518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:39.094388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554a27a-9e34-485d-a098-247201e15554 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:39.120070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c3aeb-f4ac-40fe-8e89-82442136bfc5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:39.139886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda0313-7c18-4f16-a43c-356d7ff7e126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:39.140498 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0313-7c18-4f16-a43c-356d7ff7e126 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:39.140764 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0313-7c18-4f16-a43c-356d7ff7e126 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:39.141030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0313-7c18-4f16-a43c-356d7ff7e126 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:39.141890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda0313-7c18-4f16-a43c-356d7ff7e126 None admin] RBAC: Adding query filter params (group.id=2f9ffa16b7d948538d1113b4e4d45073, role.id=c3f5b94962604da78f8e1a5d18105768, scope.project.id=86030394acc448f88cf92161d1688d4d) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:39.142192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda0313-7c18-4f16-a43c-356d7ff7e126 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:39.143809 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda0313-7c18-4f16-a43c-356d7ff7e126 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:39.152898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 162/314] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 31 14:47:38 2022] GET /identity/v3/role_assignments?group.id=2f9ffa16b7d948538d1113b4e4d45073&scope.project.id=86030394acc448f88cf92161d1688d4d&role.id=c3f5b94962604da78f8e1a5d18105768 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:39.153556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda0313-7c18-4f16-a43c-356d7ff7e126 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:39.161446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af397086-c34e-4884-b777-9d97694d97b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:39.162067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af397086-c34e-4884-b777-9d97694d97b8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:39.162346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af397086-c34e-4884-b777-9d97694d97b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:39.162614 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af397086-c34e-4884-b777-9d97694d97b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:39.163365 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af397086-c34e-4884-b777-9d97694d97b8 None admin] RBAC: Adding query filter params (group.id=2f9ffa16b7d948538d1113b4e4d45073, role.id=80aa63d20ae84a66991d542b3ed87f66, scope.project.id=86030394acc448f88cf92161d1688d4d) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:39.163667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af397086-c34e-4884-b777-9d97694d97b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:39.165178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af397086-c34e-4884-b777-9d97694d97b8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:39.172094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 153/315] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 31 14:47:38 2022] GET /identity/v3/role_assignments?group.id=2f9ffa16b7d948538d1113b4e4d45073&scope.project.id=86030394acc448f88cf92161d1688d4d&role.id=80aa63d20ae84a66991d542b3ed87f66 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:39.174205 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75a77d-139a-45f5-85cf-89868796894c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:39.174503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75a77d-139a-45f5-85cf-89868796894c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:39.174898 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75a77d-139a-45f5-85cf-89868796894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:39.199335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9b75a77d-139a-45f5-85cf-89868796894c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:39.199553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9b75a77d-139a-45f5-85cf-89868796894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:39.291962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 154/316] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:39.294366 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea346e5-a3d0-4835-9134-992dd87d4a2f None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:39.295036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:39.299789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea346e5-a3d0-4835-9134-992dd87d4a2f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:39.300066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea346e5-a3d0-4835-9134-992dd87d4a2f None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:39.302666 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 155/317] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:39.304249 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda0313-7c18-4f16-a43c-356d7ff7e126 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:39.308447 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211248ba-3fa4-4548-9340-f9177c5fd2f4 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:39.315187 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211248ba-3fa4-4548-9340-f9177c5fd2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:39.315187 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211248ba-3fa4-4548-9340-f9177c5fd2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:39.349505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-211248ba-3fa4-4548-9340-f9177c5fd2f4 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:39.350856 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-211248ba-3fa4-4548-9340-f9177c5fd2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:39.353018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6bcd4-fae0-4039-85db-8649207dbd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:39.353827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6bcd4-fae0-4039-85db-8649207dbd20 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:39.354104 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6bcd4-fae0-4039-85db-8649207dbd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:39.354375 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6bcd4-fae0-4039-85db-8649207dbd20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:39.378375 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6bcd4-fae0-4039-85db-8649207dbd20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-3fd6bcd4-fae0-4039-85db-8649207dbd20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:39.384501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:39.385497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:39.386285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:39.386285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:39.386285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:39.386285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:39.386285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:39.386285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:39.386285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:39.386285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:39.386285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:39.386285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:39.386285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 31 14:47:39.386285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:39.388671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 163/318] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:39.392827 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:39.395196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6bcd4-fae0-4039-85db-8649207dbd20 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:39.460510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 156/319] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:39.540919 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6bcd4-fae0-4039-85db-8649207dbd20 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:39.583296 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b907f03-a87a-4f5d-85fd-70ce9b851d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:39.583905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b907f03-a87a-4f5d-85fd-70ce9b851d89 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:39.584180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b907f03-a87a-4f5d-85fd-70ce9b851d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:39.584447 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b907f03-a87a-4f5d-85fd-70ce9b851d89 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:39.585107 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b907f03-a87a-4f5d-85fd-70ce9b851d89 None admin] RBAC: Adding query filter params (name=member) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:39.585472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b907f03-a87a-4f5d-85fd-70ce9b851d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:39.587482 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b907f03-a87a-4f5d-85fd-70ce9b851d89 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:39.596199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 164/320] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:47:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:39.602593 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211248ba-3fa4-4548-9340-f9177c5fd2f4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:39.687238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b907f03-a87a-4f5d-85fd-70ce9b851d89 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:39.714750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:39.722461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211248ba-3fa4-4548-9340-f9177c5fd2f4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:39.764217 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386a0e6-7fb4-437a-81f7-cb02cfdd6ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:39.765145 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386a0e6-7fb4-437a-81f7-cb02cfdd6ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:39.765629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386a0e6-7fb4-437a-81f7-cb02cfdd6ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:39.766070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386a0e6-7fb4-437a-81f7-cb02cfdd6ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:39.803469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:39.819925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b907f03-a87a-4f5d-85fd-70ce9b851d89 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:39.854306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386a0e6-7fb4-437a-81f7-cb02cfdd6ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:39.855769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386a0e6-7fb4-437a-81f7-cb02cfdd6ba0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:39.860876 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec387b59-be3e-4648-a71d-dc5000791ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:39.861849 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec387b59-be3e-4648-a71d-dc5000791ddf None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:39.862120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec387b59-be3e-4648-a71d-dc5000791ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:39.862387 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec387b59-be3e-4648-a71d-dc5000791ddf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:39.873262 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec387b59-be3e-4648-a71d-dc5000791ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-ec387b59-be3e-4648-a71d-dc5000791ddf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:39.878786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:39.879662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:39.880430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:39.880430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:39.880430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:39.880430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:39.880430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:39.880430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:39.880430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:39.880430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:39.880430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:39.880430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:39.880430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:39.880430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:39.880430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 165/321] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:47:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:39.881135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec387b59-be3e-4648-a71d-dc5000791ddf None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:39.983075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:39.984557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 157/322] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:39.985443 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386a0e6-7fb4-437a-81f7-cb02cfdd6ba0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:40.015195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec387b59-be3e-4648-a71d-dc5000791ddf None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:40.056979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66377b3-681b-41ca-8b21-d3a899bd23e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:40.057674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66377b3-681b-41ca-8b21-d3a899bd23e9 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:40.057947 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66377b3-681b-41ca-8b21-d3a899bd23e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:40.058361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66377b3-681b-41ca-8b21-d3a899bd23e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:40.058610 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:40.069968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66377b3-681b-41ca-8b21-d3a899bd23e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-b66377b3-681b-41ca-8b21-d3a899bd23e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:40.075721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:40.076629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 166/323] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:47:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:40.077658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66377b3-681b-41ca-8b21-d3a899bd23e9 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:40.106357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386a0e6-7fb4-437a-81f7-cb02cfdd6ba0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:40.148811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de845f4-0cd7-4618-8810-3ee95ca2f272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:40.148811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de845f4-0cd7-4618-8810-3ee95ca2f272 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:40.149097 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de845f4-0cd7-4618-8810-3ee95ca2f272 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:40.149165 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de845f4-0cd7-4618-8810-3ee95ca2f272 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:40.150418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de845f4-0cd7-4618-8810-3ee95ca2f272 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:40.150418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de845f4-0cd7-4618-8810-3ee95ca2f272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:40.151457 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de845f4-0cd7-4618-8810-3ee95ca2f272 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:40.161654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 158/324] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:40.163959 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de845f4-0cd7-4618-8810-3ee95ca2f272 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:40.192721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66377b3-681b-41ca-8b21-d3a899bd23e9 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:40.235158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff3b46-1f8f-46c0-86eb-2ea40ba6ad0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:40.236092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff3b46-1f8f-46c0-86eb-2ea40ba6ad0c None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:40.236364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff3b46-1f8f-46c0-86eb-2ea40ba6ad0c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:40.236633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff3b46-1f8f-46c0-86eb-2ea40ba6ad0c None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:40.238496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff3b46-1f8f-46c0-86eb-2ea40ba6ad0c None admin] RBAC: Authorizing `identity:get_project(project_id=b4b4cae986dd47d99c03d6174a8a464a)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:40.239930 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff3b46-1f8f-46c0-86eb-2ea40ba6ad0c None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:40.241606 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 167/325] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:40 2022] GET /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:40.243163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff3b46-1f8f-46c0-86eb-2ea40ba6ad0c None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:40.250801 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:40.294947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de845f4-0cd7-4618-8810-3ee95ca2f272 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:40.321354 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:40.332484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25ab3d-8329-4ed2-add9-874a6eeefe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:40.333100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25ab3d-8329-4ed2-add9-874a6eeefe77 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:40.333410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25ab3d-8329-4ed2-add9-874a6eeefe77 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:40.333708 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25ab3d-8329-4ed2-add9-874a6eeefe77 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:40.334376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25ab3d-8329-4ed2-add9-874a6eeefe77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:40.334677 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25ab3d-8329-4ed2-add9-874a6eeefe77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:40.336935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25ab3d-8329-4ed2-add9-874a6eeefe77 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:40.345795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 159/326] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:40.346392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25ab3d-8329-4ed2-add9-874a6eeefe77 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:40.359441 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff3b46-1f8f-46c0-86eb-2ea40ba6ad0c None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:40.391577 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b83a79-f354-4f38-9c32-089c328b05cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:40.392198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b83a79-f354-4f38-9c32-089c328b05cd None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:40.392467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b83a79-f354-4f38-9c32-089c328b05cd None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:40.392732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b83a79-f354-4f38-9c32-089c328b05cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:40.451978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25ab3d-8329-4ed2-add9-874a6eeefe77 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:40.459531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b83a79-f354-4f38-9c32-089c328b05cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:40.461612 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b83a79-f354-4f38-9c32-089c328b05cd None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:40.464325 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:40.486736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef03a6a-eddd-4445-991a-f4d0e95b1b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:40.487287 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef03a6a-eddd-4445-991a-f4d0e95b1b54 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:40.487560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef03a6a-eddd-4445-991a-f4d0e95b1b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:40.487825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef03a6a-eddd-4445-991a-f4d0e95b1b54 None admin] PATH_INFO: `/v3/groups/2f9ffa16b7d948538d1113b4e4d45073` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:40.488908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef03a6a-eddd-4445-991a-f4d0e95b1b54 None admin] RBAC: Authorizing `identity:get_group(group_id=2f9ffa16b7d948538d1113b4e4d45073)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:40.490353 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef03a6a-eddd-4445-991a-f4d0e95b1b54 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:40.491893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 160/327] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 31 14:47:40 2022] GET /identity/v3/groups/2f9ffa16b7d948538d1113b4e4d45073 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:40.492665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef03a6a-eddd-4445-991a-f4d0e95b1b54 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:40.547390 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:40.562918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 168/328] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:40.563562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b83a79-f354-4f38-9c32-089c328b05cd None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:40.595441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef03a6a-eddd-4445-991a-f4d0e95b1b54 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:40.629485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3d1c8-d1d6-4dbe-a540-34fd97381607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:40.630085 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3d1c8-d1d6-4dbe-a540-34fd97381607 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:40.630360 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3d1c8-d1d6-4dbe-a540-34fd97381607 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:40.630625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3d1c8-d1d6-4dbe-a540-34fd97381607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:40.662461 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b83a79-f354-4f38-9c32-089c328b05cd None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:40.665535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:40.698038 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff88d7-e5c0-4d19-ba3e-08eab2d1c721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:40.698239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3d1c8-d1d6-4dbe-a540-34fd97381607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:40.698630 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff88d7-e5c0-4d19-ba3e-08eab2d1c721 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:40.698901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff88d7-e5c0-4d19-ba3e-08eab2d1c721 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:40.699165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff88d7-e5c0-4d19-ba3e-08eab2d1c721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:40.699492 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3d1c8-d1d6-4dbe-a540-34fd97381607 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:40.699875 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff88d7-e5c0-4d19-ba3e-08eab2d1c721 None admin] RBAC: Adding query filter params (group.id=2f9ffa16b7d948538d1113b4e4d45073, role.id=c3f5b94962604da78f8e1a5d18105768, scope.project.id=b4b4cae986dd47d99c03d6174a8a464a) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:40.700177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff88d7-e5c0-4d19-ba3e-08eab2d1c721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:40.701670 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff88d7-e5c0-4d19-ba3e-08eab2d1c721 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:40.707380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 169/329] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 31 14:47:40 2022] GET /identity/v3/role_assignments?group.id=2f9ffa16b7d948538d1113b4e4d45073&scope.project.id=b4b4cae986dd47d99c03d6174a8a464a&role.id=c3f5b94962604da78f8e1a5d18105768 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:40.708008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff88d7-e5c0-4d19-ba3e-08eab2d1c721 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:40.769334 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:40.829241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 161/330] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:40.836657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3d1c8-d1d6-4dbe-a540-34fd97381607 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:40.843256 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff88d7-e5c0-4d19-ba3e-08eab2d1c721 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:40.881128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c051503-03d2-47cf-aad1-8b6806beb912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:40.881797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c051503-03d2-47cf-aad1-8b6806beb912 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:40.882540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c051503-03d2-47cf-aad1-8b6806beb912 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:40.883409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c051503-03d2-47cf-aad1-8b6806beb912 None admin] PATH_INFO: `/v3/projects/b4b4cae986dd47d99c03d6174a8a464a` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:40.884587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c051503-03d2-47cf-aad1-8b6806beb912 None admin] RBAC: Authorizing `identity:get_project(project_id=b4b4cae986dd47d99c03d6174a8a464a)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:40.886752 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c051503-03d2-47cf-aad1-8b6806beb912 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:40.889010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 170/331] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:40 2022] GET /identity/v3/projects/b4b4cae986dd47d99c03d6174a8a464a => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:40.894277 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c051503-03d2-47cf-aad1-8b6806beb912 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:40.933195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:40.951799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3d1c8-d1d6-4dbe-a540-34fd97381607 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:40.993274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41fbb5-7993-40a1-b1c0-5bda6a30775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:40.994277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41fbb5-7993-40a1-b1c0-5bda6a30775f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:40.994568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41fbb5-7993-40a1-b1c0-5bda6a30775f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:40.994840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41fbb5-7993-40a1-b1c0-5bda6a30775f None admin] PATH_INFO: `/v3/projects/e4bc3597085f4d879b8fe33c50ed5ee8` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:40.995966 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41fbb5-7993-40a1-b1c0-5bda6a30775f None admin] RBAC: Authorizing `identity:get_project(project_id=e4bc3597085f4d879b8fe33c50ed5ee8)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:40.998228 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41fbb5-7993-40a1-b1c0-5bda6a30775f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:40.999659 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 162/332] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:47:40 2022] GET /identity/v3/projects/e4bc3597085f4d879b8fe33c50ed5ee8 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:41.005565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41fbb5-7993-40a1-b1c0-5bda6a30775f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:41.011453 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c051503-03d2-47cf-aad1-8b6806beb912 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:41.033553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:41.051347 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba0541-1052-45c9-b1bd-a8d6420e914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:41.052010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba0541-1052-45c9-b1bd-a8d6420e914d None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:41.052295 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba0541-1052-45c9-b1bd-a8d6420e914d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:41.052564 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba0541-1052-45c9-b1bd-a8d6420e914d None admin] PATH_INFO: `/v3/groups/2f9ffa16b7d948538d1113b4e4d45073` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:41.053720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba0541-1052-45c9-b1bd-a8d6420e914d None admin] RBAC: Authorizing `identity:get_group(group_id=2f9ffa16b7d948538d1113b4e4d45073)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:41.055715 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba0541-1052-45c9-b1bd-a8d6420e914d None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:41.057469 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 171/333] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 31 14:47:40 2022] GET /identity/v3/groups/2f9ffa16b7d948538d1113b4e4d45073 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:41.063349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba0541-1052-45c9-b1bd-a8d6420e914d None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:41.121622 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41fbb5-7993-40a1-b1c0-5bda6a30775f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:41.155611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffc0d7-1339-412c-8d6a-6c2a0ca1d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:41.156227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc0d7-1339-412c-8d6a-6c2a0ca1d555 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:41.156519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc0d7-1339-412c-8d6a-6c2a0ca1d555 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:41.156766 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc0d7-1339-412c-8d6a-6c2a0ca1d555 None admin] PATH_INFO: `/v3/groups/8b3ee3d921294536b1967910269955dc` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:41.157866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffc0d7-1339-412c-8d6a-6c2a0ca1d555 None admin] RBAC: Authorizing `identity:get_group(group_id=8b3ee3d921294536b1967910269955dc)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:41.159279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffc0d7-1339-412c-8d6a-6c2a0ca1d555 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:41.160805 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 163/334] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Oct 31 14:47:41 2022] GET /identity/v3/groups/8b3ee3d921294536b1967910269955dc => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:41.167304 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffc0d7-1339-412c-8d6a-6c2a0ca1d555 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:41.173504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba0541-1052-45c9-b1bd-a8d6420e914d None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:41.176215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:41.206375 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b46ed-9578-4644-b254-062e7c9c7e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:41.206980 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b46ed-9578-4644-b254-062e7c9c7e8c None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:41.207258 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b46ed-9578-4644-b254-062e7c9c7e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:41.207525 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b46ed-9578-4644-b254-062e7c9c7e8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:41.208234 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b46ed-9578-4644-b254-062e7c9c7e8c None admin] RBAC: Adding query filter params (group.id=2f9ffa16b7d948538d1113b4e4d45073, role.id=80aa63d20ae84a66991d542b3ed87f66, scope.project.id=b4b4cae986dd47d99c03d6174a8a464a) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:41.208545 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b46ed-9578-4644-b254-062e7c9c7e8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:41.209982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b46ed-9578-4644-b254-062e7c9c7e8c None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:41.216583 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 172/335] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 31 14:47:41 2022] GET /identity/v3/role_assignments?group.id=2f9ffa16b7d948538d1113b4e4d45073&scope.project.id=b4b4cae986dd47d99c03d6174a8a464a&role.id=80aa63d20ae84a66991d542b3ed87f66 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:41.257218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:41.266831 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffc0d7-1339-412c-8d6a-6c2a0ca1d555 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:41.302814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3825a5-45ba-427f-9c01-ed8d7a421b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:41.303575 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3825a5-45ba-427f-9c01-ed8d7a421b7b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:41.303808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3825a5-45ba-427f-9c01-ed8d7a421b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:41.304091 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3825a5-45ba-427f-9c01-ed8d7a421b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:41.305027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3825a5-45ba-427f-9c01-ed8d7a421b7b None admin] RBAC: Adding query filter params (group.id=8b3ee3d921294536b1967910269955dc, role.id=c62ffefc63e74a1280bef2b6a22202ad, scope.project.id=e4bc3597085f4d879b8fe33c50ed5ee8) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:41.305456 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3825a5-45ba-427f-9c01-ed8d7a421b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:41.307290 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3825a5-45ba-427f-9c01-ed8d7a421b7b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:41.313725 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 164/336] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Oct 31 14:47:41 2022] GET /identity/v3/role_assignments?group.id=8b3ee3d921294536b1967910269955dc&scope.project.id=e4bc3597085f4d879b8fe33c50ed5ee8&role.id=c62ffefc63e74a1280bef2b6a22202ad => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:44.025724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e7a9-b60c-4b32-b1cf-ddb3689ceda1 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:44.026450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e7a9-b60c-4b32-b1cf-ddb3689ceda1 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:44.026450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e7a9-b60c-4b32-b1cf-ddb3689ceda1 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:44.027841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 173/337] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:44.038884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4147-adf1-4a04-a19c-6d05b0328fd7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:44.039792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4147-adf1-4a04-a19c-6d05b0328fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:44.040258 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4147-adf1-4a04-a19c-6d05b0328fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:44.066299 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dd5d4147-adf1-4a04-a19c-6d05b0328fd7 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:44.067805 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dd5d4147-adf1-4a04-a19c-6d05b0328fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:44.163507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 165/338] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:44.245635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ceb81-72fb-45f2-a454-c7142082e7e9 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:44.246223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ceb81-72fb-45f2-a454-c7142082e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:44.246698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ceb81-72fb-45f2-a454-c7142082e7e9 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:44.248227 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 174/339] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:44.253421 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be07429-e478-4f9a-8c7b-a7981bac93f5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:44.253909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be07429-e478-4f9a-8c7b-a7981bac93f5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:44.254394 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be07429-e478-4f9a-8c7b-a7981bac93f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:44.278300 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3be07429-e478-4f9a-8c7b-a7981bac93f5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:44.279767 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3be07429-e478-4f9a-8c7b-a7981bac93f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:44.369151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 166/340] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:44.494361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ceb81-72fb-45f2-a454-c7142082e7e9 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:44.588207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd88e-a8fa-4953-a37b-1f36d49c602b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:44.589897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd88e-a8fa-4953-a37b-1f36d49c602b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:44.590530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fd88e-a8fa-4953-a37b-1f36d49c602b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:44.597453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 167/341] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:47:44.613655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d789966-ad77-4fb6-ad60-e794d4236b32 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:44.614351 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d789966-ad77-4fb6-ad60-e794d4236b32 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:44.615150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d789966-ad77-4fb6-ad60-e794d4236b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:44.642235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8d789966-ad77-4fb6-ad60-e794d4236b32 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:44.644305 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8d789966-ad77-4fb6-ad60-e794d4236b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:44.650051 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ceb81-72fb-45f2-a454-c7142082e7e9 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:44.664288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:44.703296 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cba6c-bbed-4e46-9d14-45ea74c65a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:44.704502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cba6c-bbed-4e46-9d14-45ea74c65a6b None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:44.704782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cba6c-bbed-4e46-9d14-45ea74c65a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:44.705213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cba6c-bbed-4e46-9d14-45ea74c65a6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:44.721632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cba6c-bbed-4e46-9d14-45ea74c65a6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:44.723797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cba6c-bbed-4e46-9d14-45ea74c65a6b None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:44.730533 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 168/342] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:44.731415 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d789966-ad77-4fb6-ad60-e794d4236b32 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-348cba6c-bbed-4e46-9d14-45ea74c65a6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:44.747758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:44.748782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:44.749652 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:44.749652 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:44.749652 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:44.749987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 175/343] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:44.759081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cba6c-bbed-4e46-9d14-45ea74c65a6b None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:44.810409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:44.899378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d789966-ad77-4fb6-ad60-e794d4236b32 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:44.927879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cba6c-bbed-4e46-9d14-45ea74c65a6b None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:44.939251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799329e1-dc9d-4aea-986a-8359033a82a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:44.940418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799329e1-dc9d-4aea-986a-8359033a82a2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:44.940904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799329e1-dc9d-4aea-986a-8359033a82a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:44.941390 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799329e1-dc9d-4aea-986a-8359033a82a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:44.954253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799329e1-dc9d-4aea-986a-8359033a82a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:44.956852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799329e1-dc9d-4aea-986a-8359033a82a2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:44.961482 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:44.966313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a3c4e-2e3d-4dcd-b243-aec6fe268ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:44.967215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3c4e-2e3d-4dcd-b243-aec6fe268ebe None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:44.967322 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3c4e-2e3d-4dcd-b243-aec6fe268ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:44.967576 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a3c4e-2e3d-4dcd-b243-aec6fe268ebe None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:44.968282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a3c4e-2e3d-4dcd-b243-aec6fe268ebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:44.968648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a3c4e-2e3d-4dcd-b243-aec6fe268ebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:44.970131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a3c4e-2e3d-4dcd-b243-aec6fe268ebe None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-799329e1-dc9d-4aea-986a-8359033a82a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:44.976965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:44.978602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:44.979452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:44.979452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:44.979452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:44.980630 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 169/344] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:44.982032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb687977-516c-4dce-be7b-94e80501f673 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:44.982531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb687977-516c-4dce-be7b-94e80501f673 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:44.982920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb687977-516c-4dce-be7b-94e80501f673 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:44.989669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 170/345] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:44.995586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb687977-516c-4dce-be7b-94e80501f673 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:44.996783 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 176/346] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:44.998149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62f55b-ba56-4b35-bc9b-90128307617e None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:44.998528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62f55b-ba56-4b35-bc9b-90128307617e None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:44.998895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62f55b-ba56-4b35-bc9b-90128307617e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:45.023472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0a62f55b-ba56-4b35-bc9b-90128307617e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:45.025044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0a62f55b-ba56-4b35-bc9b-90128307617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:45.100307 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 177/347] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:45.101813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62f55b-ba56-4b35-bc9b-90128307617e None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:45.113258 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:45.133181 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb687977-516c-4dce-be7b-94e80501f673 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:45.179023 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f08cf-dcf0-4d1d-a581-9f51a7d4a4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:45.179967 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f08cf-dcf0-4d1d-a581-9f51a7d4a4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:45.180489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f08cf-dcf0-4d1d-a581-9f51a7d4a4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:45.180948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f08cf-dcf0-4d1d-a581-9f51a7d4a4d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:45.181949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f08cf-dcf0-4d1d-a581-9f51a7d4a4d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:45.182930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f08cf-dcf0-4d1d-a581-9f51a7d4a4d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:45.184823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f08cf-dcf0-4d1d-a581-9f51a7d4a4d2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:45.198613 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 171/348] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:45.199774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f08cf-dcf0-4d1d-a581-9f51a7d4a4d2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:45.231006 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62f55b-ba56-4b35-bc9b-90128307617e None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:45.270902 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:45.281574 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fca64-db29-48f8-856a-ddd0f826500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:45.282627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fca64-db29-48f8-856a-ddd0f826500d None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:45.287438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fca64-db29-48f8-856a-ddd0f826500d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:45.287438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fca64-db29-48f8-856a-ddd0f826500d None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:45.287438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fca64-db29-48f8-856a-ddd0f826500d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:45.287438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fca64-db29-48f8-856a-ddd0f826500d None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:45.322907 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f08cf-dcf0-4d1d-a581-9f51a7d4a4d2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:45.359453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efea65c-13fb-4742-9bc3-5fa89948cda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:45.360084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efea65c-13fb-4742-9bc3-5fa89948cda9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:45.360367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efea65c-13fb-4742-9bc3-5fa89948cda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:45.360634 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efea65c-13fb-4742-9bc3-5fa89948cda9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:45.371578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efea65c-13fb-4742-9bc3-5fa89948cda9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:45.378691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efea65c-13fb-4742-9bc3-5fa89948cda9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-4efea65c-13fb-4742-9bc3-5fa89948cda9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:45.388976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:45.390098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:45.394420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:45.394420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:45.394420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:45.394420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 172/349] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:45.394420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efea65c-13fb-4742-9bc3-5fa89948cda9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:45.442062 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 178/350] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:47:45 2022] POST /identity/v3/users => generated 246 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:45.442808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fca64-db29-48f8-856a-ddd0f826500d None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:45.521956 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efea65c-13fb-4742-9bc3-5fa89948cda9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:45.534753 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:45.550175 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:45.570942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681beed-df32-4b7b-a15a-fc3440c9dad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:45.572422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681beed-df32-4b7b-a15a-fc3440c9dad7 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:45.573231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681beed-df32-4b7b-a15a-fc3440c9dad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:45.573730 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681beed-df32-4b7b-a15a-fc3440c9dad7 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:45.574594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681beed-df32-4b7b-a15a-fc3440c9dad7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:45.576355 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681beed-df32-4b7b-a15a-fc3440c9dad7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:45.599215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fca64-db29-48f8-856a-ddd0f826500d None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:45.639793 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44bbc1-95e0-4e1a-852b-bf945463c27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:45.640435 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44bbc1-95e0-4e1a-852b-bf945463c27c None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:45.640879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44bbc1-95e0-4e1a-852b-bf945463c27c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:45.641172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44bbc1-95e0-4e1a-852b-bf945463c27c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:45.654122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44bbc1-95e0-4e1a-852b-bf945463c27c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:45.655843 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44bbc1-95e0-4e1a-852b-bf945463c27c None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-7b44bbc1-95e0-4e1a-852b-bf945463c27c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:45.670992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:45.674135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:45.674949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:45.674949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:45.674949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:45.674949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 179/351] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:45.674949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44bbc1-95e0-4e1a-852b-bf945463c27c None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:45.740197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 173/352] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:47:45 2022] POST /identity/v3/users => generated 248 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:45.740197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6fa28-d3cb-459e-8b5a-c2be005e0568 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:45.740197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6fa28-d3cb-459e-8b5a-c2be005e0568 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:45.740197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6fa28-d3cb-459e-8b5a-c2be005e0568 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:45.740197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 174/353] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:45.740197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6fa28-d3cb-459e-8b5a-c2be005e0568 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:45.802008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44bbc1-95e0-4e1a-852b-bf945463c27c None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:45.824133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:45.845353 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb21c8-96c3-4187-a98f-da98e036d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:45.846218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb21c8-96c3-4187-a98f-da98e036d55c None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:45.846629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb21c8-96c3-4187-a98f-da98e036d55c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:45.847099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb21c8-96c3-4187-a98f-da98e036d55c None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:45.847990 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb21c8-96c3-4187-a98f-da98e036d55c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:45.848646 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb21c8-96c3-4187-a98f-da98e036d55c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:45.850342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb21c8-96c3-4187-a98f-da98e036d55c None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:45.866467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 180/354] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:45.873609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d5083-50a1-473f-849b-b31a8478bd5f None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:45.874072 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d5083-50a1-473f-849b-b31a8478bd5f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:45.874487 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d5083-50a1-473f-849b-b31a8478bd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:45.884461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6fa28-d3cb-459e-8b5a-c2be005e0568 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:45.901820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-683d5083-50a1-473f-849b-b31a8478bd5f None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:45.903306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-683d5083-50a1-473f-849b-b31a8478bd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:45.931136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c5ccb-f422-431f-affa-67c65c7b4212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:45.931136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c5ccb-f422-431f-affa-67c65c7b4212 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:45.931687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c5ccb-f422-431f-affa-67c65c7b4212 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:45.932176 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c5ccb-f422-431f-affa-67c65c7b4212 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:45.932908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c5ccb-f422-431f-affa-67c65c7b4212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:45.934419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c5ccb-f422-431f-affa-67c65c7b4212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:45.935001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c5ccb-f422-431f-affa-67c65c7b4212 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:45.948110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 175/355] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:45.952924 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c5ccb-f422-431f-affa-67c65c7b4212 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:45.984564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:46.010165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 181/356] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:46.012388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d5083-50a1-473f-849b-b31a8478bd5f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:46.120870 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c5ccb-f422-431f-affa-67c65c7b4212 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:46.168716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d5083-50a1-473f-849b-b31a8478bd5f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:46.181278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:46.206133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1db0d8-9c21-456a-8318-329bdd787139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:46.206843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1db0d8-9c21-456a-8318-329bdd787139 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:46.207021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1db0d8-9c21-456a-8318-329bdd787139 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:46.207281 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1db0d8-9c21-456a-8318-329bdd787139 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:46.208032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1db0d8-9c21-456a-8318-329bdd787139 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:46.209567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1db0d8-9c21-456a-8318-329bdd787139 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:46.211301 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7240ff8-0a83-46b6-a627-05697b96471a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:46.212128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7240ff8-0a83-46b6-a627-05697b96471a None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:46.212591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7240ff8-0a83-46b6-a627-05697b96471a None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:46.213147 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7240ff8-0a83-46b6-a627-05697b96471a None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:46.214022 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7240ff8-0a83-46b6-a627-05697b96471a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:46.215662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7240ff8-0a83-46b6-a627-05697b96471a None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:46.331332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 176/357] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:47:45 2022] POST /identity/v3/users => generated 248 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:46.363774 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 182/358] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:47:46 2022] POST /identity/v3/users => generated 249 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:46.398717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1db0d8-9c21-456a-8318-329bdd787139 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:46.505233 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:46.528634 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1db0d8-9c21-456a-8318-329bdd787139 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:46.567220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b644e0-cc38-41ba-8798-939dce624996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:46.568631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b644e0-cc38-41ba-8798-939dce624996 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:46.568914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b644e0-cc38-41ba-8798-939dce624996 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:46.569194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b644e0-cc38-41ba-8798-939dce624996 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:46.570437 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b644e0-cc38-41ba-8798-939dce624996 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:46.572090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b644e0-cc38-41ba-8798-939dce624996 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:46.642308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.sql.core [None req-57b644e0-cc38-41ba-8798-939dce624996 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 14:47:46.642308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 31 14:47:46.642308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [parameters: {'id': 'a3143c8b0a7643ba85c276f054f360cb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 31 14:47:46.642308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81683) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-57b644e0-cc38-41ba-8798-939dce624996 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application conn.query(q) Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result.read() Oct 31 14:47:46.650090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return ref.to_dict() Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:47:46.652934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application yield resource Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise self.value Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application session.commit() Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 14:47:46.653939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.session.flush() Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application compat.raise_( Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 14:47:46.655046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:47:46.655934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application conn.query(q) Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result.read() Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:47:46.656803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [parameters: {'id': 'a3143c8b0a7643ba85c276f054f360cb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:46.658970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 31 14:47:46.660883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:46.662897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 177/359] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Oct 31 14:47:46 2022] POST /identity/v3/roles => generated 144 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:46.668389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7240ff8-0a83-46b6-a627-05697b96471a None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:46.786210 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7240ff8-0a83-46b6-a627-05697b96471a None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:46.833214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33030585-e806-401d-90ba-84425c33c52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:46.834266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33030585-e806-401d-90ba-84425c33c52b None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:46.834735 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33030585-e806-401d-90ba-84425c33c52b None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:46.835192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33030585-e806-401d-90ba-84425c33c52b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:46.852478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33030585-e806-401d-90ba-84425c33c52b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-33030585-e806-401d-90ba-84425c33c52b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:46.858161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:46.859030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:46.859817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:46.859817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:46.859817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:46.859817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:46.859817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:46.859817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:46.859817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:46.859817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:46.859817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:46.859817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:46.859817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 31 14:47:46.859817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:46.862337 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 183/360] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:47:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:46.868853 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b644e0-cc38-41ba-8798-939dce624996 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:47.036048 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b644e0-cc38-41ba-8798-939dce624996 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:47.083295 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c8303-6adc-437b-a9ac-f87b851a1c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:47.083913 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c8303-6adc-437b-a9ac-f87b851a1c95 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:47.084195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c8303-6adc-437b-a9ac-f87b851a1c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:47.084459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c8303-6adc-437b-a9ac-f87b851a1c95 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:47.085133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c8303-6adc-437b-a9ac-f87b851a1c95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:47.085457 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c8303-6adc-437b-a9ac-f87b851a1c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:47.087501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c8303-6adc-437b-a9ac-f87b851a1c95 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:47.101440 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 178/361] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:47.790249 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0b81e-4aad-430e-93ef-d10292be7212 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:47.790761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0b81e-4aad-430e-93ef-d10292be7212 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:47.790761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0b81e-4aad-430e-93ef-d10292be7212 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:47.792244 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 184/362] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:47.797625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46598058-e7a8-4139-9a23-c63e286eb140 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:47.798402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46598058-e7a8-4139-9a23-c63e286eb140 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:47.798872 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46598058-e7a8-4139-9a23-c63e286eb140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:47.813554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:47.819276 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-46598058-e7a8-4139-9a23-c63e286eb140 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:47.820557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-46598058-e7a8-4139-9a23-c63e286eb140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:47.907233 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 179/363] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:48.118942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2ef48-059c-4756-8888-864f51f8c1e4 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.119220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2ef48-059c-4756-8888-864f51f8c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.119490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2ef48-059c-4756-8888-864f51f8c1e4 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.120819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 185/364] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:48.126222 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1dea1-609a-437b-91a0-a8b9a1bf86db None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.126510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1dea1-609a-437b-91a0-a8b9a1bf86db None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.126788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1dea1-609a-437b-91a0-a8b9a1bf86db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.146132 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5cc1dea1-609a-437b-91a0-a8b9a1bf86db None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:48.147315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5cc1dea1-609a-437b-91a0-a8b9a1bf86db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:48.214566 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 180/365] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:48.303178 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2ef48-059c-4756-8888-864f51f8c1e4 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:48.337478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:48.432820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2ef48-059c-4756-8888-864f51f8c1e4 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:48.476962 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5d2f8-e6aa-4572-a74c-cff741e3a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:48.477629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5d2f8-e6aa-4572-a74c-cff741e3a633 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.477971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5d2f8-e6aa-4572-a74c-cff741e3a633 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.478242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5d2f8-e6aa-4572-a74c-cff741e3a633 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.495238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5d2f8-e6aa-4572-a74c-cff741e3a633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-d6e5d2f8-e6aa-4572-a74c-cff741e3a633 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:48.500722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:48.501594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:48.502955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:48.502955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:48.502955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:48.502955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:48.502955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:48.502955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:48.502955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:48.502955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:48.502955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:48.502955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:48.502955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:48.502955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:48.502955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 186/366] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:47:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:48.507594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1dea1-609a-437b-91a0-a8b9a1bf86db None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:48.574062 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:48.608926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1dea1-609a-437b-91a0-a8b9a1bf86db None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:48.659018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208a788-b340-4017-a454-b2cf87b87585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:48.659646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208a788-b340-4017-a454-b2cf87b87585 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.659924 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208a788-b340-4017-a454-b2cf87b87585 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.660195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208a788-b340-4017-a454-b2cf87b87585 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.660868 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208a788-b340-4017-a454-b2cf87b87585 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:48.661167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208a788-b340-4017-a454-b2cf87b87585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:48.662566 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208a788-b340-4017-a454-b2cf87b87585 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:48.668490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5d2f8-e6aa-4572-a74c-cff741e3a633 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:48.675472 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 181/367] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:47:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:48.681264 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208a788-b340-4017-a454-b2cf87b87585 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:48.802714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208a788-b340-4017-a454-b2cf87b87585 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:48.830155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:48.838862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fa456-83e7-4b8e-b1d5-674de65c1e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:48.839494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fa456-83e7-4b8e-b1d5-674de65c1e5a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:48.841859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fa456-83e7-4b8e-b1d5-674de65c1e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:48.841859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fa456-83e7-4b8e-b1d5-674de65c1e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:48.850812 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fa456-83e7-4b8e-b1d5-674de65c1e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:48.852846 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fa456-83e7-4b8e-b1d5-674de65c1e5a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-168fa456-83e7-4b8e-b1d5-674de65c1e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:48.867584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:48.868484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:48.869367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:48.869367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:48.869367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:48.869367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 182/368] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:47:48.875664 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fa456-83e7-4b8e-b1d5-674de65c1e5a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:48.876765 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:48.896406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5d2f8-e6aa-4572-a74c-cff741e3a633 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:49.029316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22385a62-5660-4075-9ce3-f442f8d71693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:49.030220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22385a62-5660-4075-9ce3-f442f8d71693 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:49.030488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22385a62-5660-4075-9ce3-f442f8d71693 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:49.030750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22385a62-5660-4075-9ce3-f442f8d71693 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:49.064292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22385a62-5660-4075-9ce3-f442f8d71693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-22385a62-5660-4075-9ce3-f442f8d71693 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:49.077941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:49.080113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:49.082096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:49.082096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:49.082096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:49.082096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:49.082096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:49.082096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:49.082096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:49.082096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:49.082096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:49.082096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:49.082096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:49.082096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:49.082096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 187/369] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:47:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:49.089561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22385a62-5660-4075-9ce3-f442f8d71693 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:49.149330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fa456-83e7-4b8e-b1d5-674de65c1e5a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:49.197703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b08f6-b511-4e3c-9af4-d95eedc69297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:49.198308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b08f6-b511-4e3c-9af4-d95eedc69297 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:49.198582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b08f6-b511-4e3c-9af4-d95eedc69297 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:49.198848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b08f6-b511-4e3c-9af4-d95eedc69297 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:49.199478 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b08f6-b511-4e3c-9af4-d95eedc69297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:49.199774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b08f6-b511-4e3c-9af4-d95eedc69297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:49.201118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b08f6-b511-4e3c-9af4-d95eedc69297 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:49.212862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 183/370] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:49.218419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9403b-bed1-4419-831f-881243b83d00 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:49.218697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9403b-bed1-4419-831f-881243b83d00 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:49.218965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9403b-bed1-4419-831f-881243b83d00 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:49.220336 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 184/371] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:49.221214 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f199ce8-9813-4a4f-982a-ed4fb4b38529 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:49.221514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f199ce8-9813-4a4f-982a-ed4fb4b38529 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:49.221781 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f199ce8-9813-4a4f-982a-ed4fb4b38529 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:49.225398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 185/372] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:49.226792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f199ce8-9813-4a4f-982a-ed4fb4b38529 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:49.237124 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22385a62-5660-4075-9ce3-f442f8d71693 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:49.272087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff741b9a-eae9-480f-9256-c0df7e3dd409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:49.272686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff741b9a-eae9-480f-9256-c0df7e3dd409 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:49.273534 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff741b9a-eae9-480f-9256-c0df7e3dd409 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:49.273983 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff741b9a-eae9-480f-9256-c0df7e3dd409 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:49.274644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff741b9a-eae9-480f-9256-c0df7e3dd409 None admin] RBAC: Adding query filter params (name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:49.274941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff741b9a-eae9-480f-9256-c0df7e3dd409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:49.276343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff741b9a-eae9-480f-9256-c0df7e3dd409 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:49.277267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:49.285209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 188/373] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:47:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:49.286439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed815981-69c0-461a-b8bd-e0a361eb6c90 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:49.286652 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed815981-69c0-461a-b8bd-e0a361eb6c90 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:49.286923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed815981-69c0-461a-b8bd-e0a361eb6c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:49.303365 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:49.309557 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-ed815981-69c0-461a-b8bd-e0a361eb6c90 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:49.310748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ed815981-69c0-461a-b8bd-e0a361eb6c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:49.339037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f199ce8-9813-4a4f-982a-ed4fb4b38529 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:49.373577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603159a-2418-45e6-aed8-e6b7c7d53723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:49.374837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603159a-2418-45e6-aed8-e6b7c7d53723 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:49.375364 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603159a-2418-45e6-aed8-e6b7c7d53723 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:49.375807 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603159a-2418-45e6-aed8-e6b7c7d53723 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:49.380237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 189/374] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:49.381558 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2ff09-6bb4-4c0f-9b9f-0ce31f6585e6 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:49.381905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2ff09-6bb4-4c0f-9b9f-0ce31f6585e6 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:49.382225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2ff09-6bb4-4c0f-9b9f-0ce31f6585e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:49.394629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603159a-2418-45e6-aed8-e6b7c7d53723 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:49.396888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603159a-2418-45e6-aed8-e6b7c7d53723 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:49.400488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-78d2ff09-6bb4-4c0f-9b9f-0ce31f6585e6 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:49.401803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-78d2ff09-6bb4-4c0f-9b9f-0ce31f6585e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5603159a-2418-45e6-aed8-e6b7c7d53723 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:47:49.414476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:49.415410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:49.416283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:49.416283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:49.416283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:47:49.416283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:47:49.416283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:47:49.416283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:47:49.416283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:47:49.416283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:47:49.416283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 14:47:49.416283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:49.419234 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 186/375] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 31 14:47:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:49.420215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603159a-2418-45e6-aed8-e6b7c7d53723 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:49.488457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 190/376] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:49.489958 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2ff09-6bb4-4c0f-9b9f-0ce31f6585e6 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:49.532461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:49.535973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603159a-2418-45e6-aed8-e6b7c7d53723 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:49.570547 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff39f2-5835-432d-a33f-e6be7ae93438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:49.571458 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff39f2-5835-432d-a33f-e6be7ae93438 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:49.572050 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff39f2-5835-432d-a33f-e6be7ae93438 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:49.573050 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff39f2-5835-432d-a33f-e6be7ae93438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:49.581590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:49.585159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff39f2-5835-432d-a33f-e6be7ae93438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:49.587050 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff39f2-5835-432d-a33f-e6be7ae93438 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5dff39f2-5835-432d-a33f-e6be7ae93438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:49.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:49.604310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:49.605396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:49.605396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:49.605396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:49.606744 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 187/377] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:49.613125 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff39f2-5835-432d-a33f-e6be7ae93438 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:49.627955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2ff09-6bb4-4c0f-9b9f-0ce31f6585e6 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:49.671849 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4fee8-1d29-4dfe-a5cd-353e8c6b2621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:49.672700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4fee8-1d29-4dfe-a5cd-353e8c6b2621 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:49.673754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4fee8-1d29-4dfe-a5cd-353e8c6b2621 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:49.674174 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4fee8-1d29-4dfe-a5cd-353e8c6b2621 None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:49.675048 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4fee8-1d29-4dfe-a5cd-353e8c6b2621 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:49.675491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4fee8-1d29-4dfe-a5cd-353e8c6b2621 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:49.677561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4fee8-1d29-4dfe-a5cd-353e8c6b2621 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:49.724229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 191/378] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 31 14:47:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:49.725238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4fee8-1d29-4dfe-a5cd-353e8c6b2621 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:49.749920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff39f2-5835-432d-a33f-e6be7ae93438 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:49.794003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911afd11-3936-4dac-b7c5-dc4f083bb70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:49.795032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911afd11-3936-4dac-b7c5-dc4f083bb70f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:49.795497 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911afd11-3936-4dac-b7c5-dc4f083bb70f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:49.795979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911afd11-3936-4dac-b7c5-dc4f083bb70f None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:49.797013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911afd11-3936-4dac-b7c5-dc4f083bb70f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:49.797386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911afd11-3936-4dac-b7c5-dc4f083bb70f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:49.798879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911afd11-3936-4dac-b7c5-dc4f083bb70f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:49.816786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 188/379] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:49.818245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911afd11-3936-4dac-b7c5-dc4f083bb70f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:49.834724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:49.860264 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4fee8-1d29-4dfe-a5cd-353e8c6b2621 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:49.888106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:49.900734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c68050-4e9f-4bea-b6c1-ddb893e8df46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:49.901399 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c68050-4e9f-4bea-b6c1-ddb893e8df46 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:49.901679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c68050-4e9f-4bea-b6c1-ddb893e8df46 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:49.901946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c68050-4e9f-4bea-b6c1-ddb893e8df46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:49.912262 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c68050-4e9f-4bea-b6c1-ddb893e8df46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-78c68050-4e9f-4bea-b6c1-ddb893e8df46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:49.918172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:49.919164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:49.919965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:49.919965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:49.919965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:49.919965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:49.919965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:49.919965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:49.919965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:49.919965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:49.919965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:49.919965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:49.919965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:49.919965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:49.919965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 192/380] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:47:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:49.920620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c68050-4e9f-4bea-b6c1-ddb893e8df46 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:49.998617 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911afd11-3936-4dac-b7c5-dc4f083bb70f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:50.041021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b996b2-92f6-4b02-991b-5e740545377a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:50.041691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b996b2-92f6-4b02-991b-5e740545377a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.041973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b996b2-92f6-4b02-991b-5e740545377a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.042249 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b996b2-92f6-4b02-991b-5e740545377a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.055620 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b996b2-92f6-4b02-991b-5e740545377a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:50.057135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b996b2-92f6-4b02-991b-5e740545377a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:50.072290 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c68050-4e9f-4bea-b6c1-ddb893e8df46 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f0b996b2-92f6-4b02-991b-5e740545377a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:50.073985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:50.074877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:50.075717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:50.075717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:50.075717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:50.075717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 189/381] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:50.075935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b996b2-92f6-4b02-991b-5e740545377a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:50.112559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5103d-b2d4-47b1-948a-36fde99d96eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:50.113135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5103d-b2d4-47b1-948a-36fde99d96eb None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.113441 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5103d-b2d4-47b1-948a-36fde99d96eb None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.113715 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5103d-b2d4-47b1-948a-36fde99d96eb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.121519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5103d-b2d4-47b1-948a-36fde99d96eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:50.123036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5103d-b2d4-47b1-948a-36fde99d96eb None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-2af5103d-b2d4-47b1-948a-36fde99d96eb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:47:50.138880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:50.139823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:50.140700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:50.140700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:50.140700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:47:50.140700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:47:50.140700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:47:50.140700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:47:50.140700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:47:50.140700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:47:50.140700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 31 14:47:50.140700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:50.140700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 193/382] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:50.141934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5103d-b2d4-47b1-948a-36fde99d96eb None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:50.147007 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:50.184135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b996b2-92f6-4b02-991b-5e740545377a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:50.190644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:50.219997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4948b5-97d0-4fd6-9b1b-125e84d97aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:50.220877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4948b5-97d0-4fd6-9b1b-125e84d97aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.221276 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4948b5-97d0-4fd6-9b1b-125e84d97aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.221746 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4948b5-97d0-4fd6-9b1b-125e84d97aa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.233472 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4948b5-97d0-4fd6-9b1b-125e84d97aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-6b4948b5-97d0-4fd6-9b1b-125e84d97aa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:50.239927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:50.240976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:50.242147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:50.242147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:50.242147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:50.242147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:50.242147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:50.242147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:50.242147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:50.242147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:50.242147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:50.242147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:50.242147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:50.242147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:50.246836 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5103d-b2d4-47b1-948a-36fde99d96eb None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:50.247290 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 190/383] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:47:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:50.248179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4948b5-97d0-4fd6-9b1b-125e84d97aa3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:50.280829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7e7d0-baf1-44ad-990e-1c28bc121f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:50.281466 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7e7d0-baf1-44ad-990e-1c28bc121f3c None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.281740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7e7d0-baf1-44ad-990e-1c28bc121f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.282009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7e7d0-baf1-44ad-990e-1c28bc121f3c None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.282663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7e7d0-baf1-44ad-990e-1c28bc121f3c None admin] RBAC: Adding query filter params (name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:50.282963 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7e7d0-baf1-44ad-990e-1c28bc121f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:50.284335 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7e7d0-baf1-44ad-990e-1c28bc121f3c None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:50.292204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 194/384] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:47:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:50.293361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6671cd-28a6-41f5-bcf6-647312c1f7bc None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.293643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6671cd-28a6-41f5-bcf6-647312c1f7bc None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.293923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6671cd-28a6-41f5-bcf6-647312c1f7bc None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.295114 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 195/385] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:50.298065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6671cd-28a6-41f5-bcf6-647312c1f7bc None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:50.354258 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4948b5-97d0-4fd6-9b1b-125e84d97aa3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:50.376923 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:50.387726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b36153-1682-45d4-b7b5-c927ba49d629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:50.389719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b36153-1682-45d4-b7b5-c927ba49d629 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.389719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b36153-1682-45d4-b7b5-c927ba49d629 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.389719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b36153-1682-45d4-b7b5-c927ba49d629 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.389719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b36153-1682-45d4-b7b5-c927ba49d629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:50.390005 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b36153-1682-45d4-b7b5-c927ba49d629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:50.391102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b36153-1682-45d4-b7b5-c927ba49d629 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:50.400291 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6671cd-28a6-41f5-bcf6-647312c1f7bc None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:50.402002 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 191/386] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:50.402786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b36153-1682-45d4-b7b5-c927ba49d629 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:50.410713 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:50.439068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c7b3a-356d-4ec9-a231-f2abe316de19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:50.439667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c7b3a-356d-4ec9-a231-f2abe316de19 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.439942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c7b3a-356d-4ec9-a231-f2abe316de19 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.440211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c7b3a-356d-4ec9-a231-f2abe316de19 None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.440985 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c7b3a-356d-4ec9-a231-f2abe316de19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:50.441317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c7b3a-356d-4ec9-a231-f2abe316de19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:50.442749 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c7b3a-356d-4ec9-a231-f2abe316de19 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:50.459629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 196/387] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Oct 31 14:47:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:50.460455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c7b3a-356d-4ec9-a231-f2abe316de19 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:50.506307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b36153-1682-45d4-b7b5-c927ba49d629 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:50.540762 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d521a5b-2ad0-4886-9a96-8eda0e038685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:50.541382 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d521a5b-2ad0-4886-9a96-8eda0e038685 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.541654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d521a5b-2ad0-4886-9a96-8eda0e038685 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.541921 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d521a5b-2ad0-4886-9a96-8eda0e038685 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.542567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d521a5b-2ad0-4886-9a96-8eda0e038685 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:50.542860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d521a5b-2ad0-4886-9a96-8eda0e038685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:50.544204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d521a5b-2ad0-4886-9a96-8eda0e038685 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:50.551744 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 192/388] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:47:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:50.552853 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86553fb1-ce52-44f5-816b-58c4cee1361b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.553129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86553fb1-ce52-44f5-816b-58c4cee1361b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.553421 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86553fb1-ce52-44f5-816b-58c4cee1361b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.564764 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c7b3a-356d-4ec9-a231-f2abe316de19 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:50.571226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-86553fb1-ce52-44f5-816b-58c4cee1361b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:50.572406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-86553fb1-ce52-44f5-816b-58c4cee1361b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:50.600754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874bdf5-84da-42b4-8096-9fa405515f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:50.602345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874bdf5-84da-42b4-8096-9fa405515f62 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.602776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874bdf5-84da-42b4-8096-9fa405515f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.603096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874bdf5-84da-42b4-8096-9fa405515f62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.614300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874bdf5-84da-42b4-8096-9fa405515f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:50.615643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:50.615756 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874bdf5-84da-42b4-8096-9fa405515f62 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-a874bdf5-84da-42b4-8096-9fa405515f62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:50.632035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:50.633018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:50.633910 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:50.633910 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:50.633910 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:50.633910 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 197/389] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:50.634891 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874bdf5-84da-42b4-8096-9fa405515f62 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:50.643550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 193/390] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:50.644254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86553fb1-ce52-44f5-816b-58c4cee1361b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:50.663382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:50.749195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874bdf5-84da-42b4-8096-9fa405515f62 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:50.765417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86553fb1-ce52-44f5-816b-58c4cee1361b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:50.785911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970f075-d45f-45b5-8ed6-bef7526a5b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:50.786532 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970f075-d45f-45b5-8ed6-bef7526a5b0d None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.786814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970f075-d45f-45b5-8ed6-bef7526a5b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.787082 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970f075-d45f-45b5-8ed6-bef7526a5b0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.794414 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970f075-d45f-45b5-8ed6-bef7526a5b0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:50.795992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970f075-d45f-45b5-8ed6-bef7526a5b0d None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:50.799564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33150ddf-33de-4f78-84a6-b9d7e66f9257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:50.800182 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33150ddf-33de-4f78-84a6-b9d7e66f9257 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.800456 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33150ddf-33de-4f78-84a6-b9d7e66f9257 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.800718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33150ddf-33de-4f78-84a6-b9d7e66f9257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-f970f075-d45f-45b5-8ed6-bef7526a5b0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:47:50.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:50.809587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:50.810610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:47:50.810610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:47:50.810610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:47:50.810610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:47:50.810610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:47:50.810610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:47:50.810610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:50.810610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:50.810610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 198/391] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:50.810610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970f075-d45f-45b5-8ed6-bef7526a5b0d None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:50.816061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33150ddf-33de-4f78-84a6-b9d7e66f9257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:50.817531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33150ddf-33de-4f78-84a6-b9d7e66f9257 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-33150ddf-33de-4f78-84a6-b9d7e66f9257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:50.833147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:50.834075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:50.835046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:50.835046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:50.835046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:50.835046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 194/392] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:50.835046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33150ddf-33de-4f78-84a6-b9d7e66f9257 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:50.872178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:50.901472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:50.923986 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970f075-d45f-45b5-8ed6-bef7526a5b0d None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:50.946414 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33150ddf-33de-4f78-84a6-b9d7e66f9257 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:50.957445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229128b-dc1c-4953-9b2c-c14e645b386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:50.958058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229128b-dc1c-4953-9b2c-c14e645b386a None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.958330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229128b-dc1c-4953-9b2c-c14e645b386a None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.958602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229128b-dc1c-4953-9b2c-c14e645b386a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.972372 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229128b-dc1c-4953-9b2c-c14e645b386a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:50.973858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229128b-dc1c-4953-9b2c-c14e645b386a None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:50.985194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4224e38-07b1-4a84-a715-bed5223c6800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:50.985840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4224e38-07b1-4a84-a715-bed5223c6800 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:50.986118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4224e38-07b1-4a84-a715-bed5223c6800 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:50.986388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4224e38-07b1-4a84-a715-bed5223c6800 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:50.987027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4224e38-07b1-4a84-a715-bed5223c6800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:50.987327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4224e38-07b1-4a84-a715-bed5223c6800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:50.988690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4224e38-07b1-4a84-a715-bed5223c6800 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-a229128b-dc1c-4953-9b2c-c14e645b386a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:50.990433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:50.991297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:50.992445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:50.992445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:50.992445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:50.992445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 199/393] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:50.992853 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229128b-dc1c-4953-9b2c-c14e645b386a None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:51.004004 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 195/394] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:51.004945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4224e38-07b1-4a84-a715-bed5223c6800 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:51.093301 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229128b-dc1c-4953-9b2c-c14e645b386a None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:51.093883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:51.106825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4224e38-07b1-4a84-a715-bed5223c6800 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:51.117893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:51.125550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc331fa3-a41c-41f4-a78b-145145c5808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:51.126146 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc331fa3-a41c-41f4-a78b-145145c5808e None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:51.126420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc331fa3-a41c-41f4-a78b-145145c5808e None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:51.126683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc331fa3-a41c-41f4-a78b-145145c5808e None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:51.127389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc331fa3-a41c-41f4-a78b-145145c5808e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:51.127685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc331fa3-a41c-41f4-a78b-145145c5808e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:51.129110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc331fa3-a41c-41f4-a78b-145145c5808e None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:51.141411 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4bab2-92e1-42ad-88db-82c1fff36750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:51.142008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4bab2-92e1-42ad-88db-82c1fff36750 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:51.142288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4bab2-92e1-42ad-88db-82c1fff36750 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:51.142558 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4bab2-92e1-42ad-88db-82c1fff36750 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:51.143192 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4bab2-92e1-42ad-88db-82c1fff36750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:51.143564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4bab2-92e1-42ad-88db-82c1fff36750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:51.144826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4bab2-92e1-42ad-88db-82c1fff36750 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:51.146441 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 200/395] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:47:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:51.147235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc331fa3-a41c-41f4-a78b-145145c5808e None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:51.161968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 196/396] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:51.161968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4bab2-92e1-42ad-88db-82c1fff36750 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:51.246676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc331fa3-a41c-41f4-a78b-145145c5808e None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:51.257668 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4bab2-92e1-42ad-88db-82c1fff36750 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:51.278800 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57438eb-894a-4c18-bd4b-75c032f09e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:51.279424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57438eb-894a-4c18-bd4b-75c032f09e30 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:51.279967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57438eb-894a-4c18-bd4b-75c032f09e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:51.280241 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57438eb-894a-4c18-bd4b-75c032f09e30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:51.290797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13a4e7-d955-4a65-8e39-84ce0beace5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:51.290935 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57438eb-894a-4c18-bd4b-75c032f09e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:51.291393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13a4e7-d955-4a65-8e39-84ce0beace5f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:51.291669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13a4e7-d955-4a65-8e39-84ce0beace5f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:51.291939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13a4e7-d955-4a65-8e39-84ce0beace5f None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:51.292387 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57438eb-894a-4c18-bd4b-75c032f09e30 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:51.292575 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13a4e7-d955-4a65-8e39-84ce0beace5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:51.292874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13a4e7-d955-4a65-8e39-84ce0beace5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:51.294237 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13a4e7-d955-4a65-8e39-84ce0beace5f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:51.305514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 197/397] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:51.306303 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13a4e7-d955-4a65-8e39-84ce0beace5f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-b57438eb-894a-4c18-bd4b-75c032f09e30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:51.306551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:51.307393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:51.308218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:51.308218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:51.308218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:51.308218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 201/398] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:51.308430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57438eb-894a-4c18-bd4b-75c032f09e30 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:51.322888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:51.351304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:51.408153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57438eb-894a-4c18-bd4b-75c032f09e30 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:51.410057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13a4e7-d955-4a65-8e39-84ce0beace5f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:51.441017 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224049f-97da-47c6-9be1-0c6f05011e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:51.441620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224049f-97da-47c6-9be1-0c6f05011e14 None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:51.441895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224049f-97da-47c6-9be1-0c6f05011e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:51.442158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224049f-97da-47c6-9be1-0c6f05011e14 None admin] PATH_INFO: `/v3/projects/b82a0373e3b649f3a023efd8db204123/users/9ec30e419d6f4fddb05c4bb08f2ce3f0/roles/bc1117423b4841a4ae3e7be8f54af3b7` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:51.444125 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e10fe-e77b-4e01-996f-4cb362daaeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:51.444834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e10fe-e77b-4e01-996f-4cb362daaeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:51.445647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e10fe-e77b-4e01-996f-4cb362daaeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:51.445924 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e10fe-e77b-4e01-996f-4cb362daaeb4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:51.452790 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e10fe-e77b-4e01-996f-4cb362daaeb4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:51.454253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e10fe-e77b-4e01-996f-4cb362daaeb4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:51.456581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224049f-97da-47c6-9be1-0c6f05011e14 None admin] RBAC: Authorizing `identity:create_grant(project_id=b82a0373e3b649f3a023efd8db204123, user_id=9ec30e419d6f4fddb05c4bb08f2ce3f0, role_id=bc1117423b4841a4ae3e7be8f54af3b7)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:51.458017 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224049f-97da-47c6-9be1-0c6f05011e14 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-380e10fe-e77b-4e01-996f-4cb362daaeb4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:47:51.465646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:51.466675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:51.467837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:51.467837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:51.467837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:47:51.467837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:47:51.467837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:47:51.467837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:47:51.467837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:47:51.467837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:47:51.467837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 14:47:51.467837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:51.467837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 198/399] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:51.467837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e10fe-e77b-4e01-996f-4cb362daaeb4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:51.530738 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:51.561649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 202/400] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:51 2022] PUT /identity/v3/projects/b82a0373e3b649f3a023efd8db204123/users/9ec30e419d6f4fddb05c4bb08f2ce3f0/roles/bc1117423b4841a4ae3e7be8f54af3b7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:51.562513 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224049f-97da-47c6-9be1-0c6f05011e14 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:51.564392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e10fe-e77b-4e01-996f-4cb362daaeb4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:51.603282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9daa27-9df4-460e-af1c-a10a7628a640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:51.604017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9daa27-9df4-460e-af1c-a10a7628a640 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:51.604345 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9daa27-9df4-460e-af1c-a10a7628a640 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:51.605660 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9daa27-9df4-460e-af1c-a10a7628a640 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:51.611891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9daa27-9df4-460e-af1c-a10a7628a640 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:51.613405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9daa27-9df4-460e-af1c-a10a7628a640 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-7f9daa27-9df4-460e-af1c-a10a7628a640 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:47:51.626591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:51.627686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:51.633973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:47:51.633973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:47:51.633973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:47:51.633973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:47:51.633973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:47:51.633973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:47:51.633973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:51.633973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:51.633973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 199/401] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:51.633973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9daa27-9df4-460e-af1c-a10a7628a640 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:51.682054 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:51.700350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224049f-97da-47c6-9be1-0c6f05011e14 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:51.732051 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ca6f5-4881-43bb-8a28-b3a588f025e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:51.732783 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ca6f5-4881-43bb-8a28-b3a588f025e2 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:51.733065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ca6f5-4881-43bb-8a28-b3a588f025e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:51.733357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ca6f5-4881-43bb-8a28-b3a588f025e2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:51.743395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ca6f5-4881-43bb-8a28-b3a588f025e2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:51.744961 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ca6f5-4881-43bb-8a28-b3a588f025e2 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:51.751144 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9daa27-9df4-460e-af1c-a10a7628a640 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-478ca6f5-4881-43bb-8a28-b3a588f025e2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:47:51.758808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:51.759702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:51.760572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:51.760572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:51.760572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:47:51.760572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:47:51.760572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:47:51.760572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:47:51.760572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:47:51.760572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:47:51.760572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 14:47:51.760572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:51.760572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 203/402] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:47:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:51.761109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ca6f5-4881-43bb-8a28-b3a588f025e2 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:51.783128 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:51.792108 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9b9dd-7fe5-453f-b0e7-16563b303df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:51.800485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9b9dd-7fe5-453f-b0e7-16563b303df0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:51.800485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9b9dd-7fe5-453f-b0e7-16563b303df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:51.800485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9b9dd-7fe5-453f-b0e7-16563b303df0 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:51.800485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9b9dd-7fe5-453f-b0e7-16563b303df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:51.800485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9b9dd-7fe5-453f-b0e7-16563b303df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:51.800485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9b9dd-7fe5-453f-b0e7-16563b303df0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:51.808694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 200/403] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:51.809823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9b9dd-7fe5-453f-b0e7-16563b303df0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:51.879762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ca6f5-4881-43bb-8a28-b3a588f025e2 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:51.918144 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c8772-00be-46e2-b529-0d03b9f9eecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:51.918918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c8772-00be-46e2-b529-0d03b9f9eecd None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:51.919125 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c8772-00be-46e2-b529-0d03b9f9eecd None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:51.919396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c8772-00be-46e2-b529-0d03b9f9eecd None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:51.919595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9b9dd-7fe5-453f-b0e7-16563b303df0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:51.920117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c8772-00be-46e2-b529-0d03b9f9eecd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:51.920413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c8772-00be-46e2-b529-0d03b9f9eecd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:51.921925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c8772-00be-46e2-b529-0d03b9f9eecd None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:51.939923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 204/404] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Oct 31 14:47:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:51.940548 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c8772-00be-46e2-b529-0d03b9f9eecd None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:51.951846 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:51.960713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3de82-bd5c-42a3-be2b-71bb250529b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:51.961498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3de82-bd5c-42a3-be2b-71bb250529b2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:51.962062 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3de82-bd5c-42a3-be2b-71bb250529b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:51.962338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3de82-bd5c-42a3-be2b-71bb250529b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:51.963035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3de82-bd5c-42a3-be2b-71bb250529b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:51.963339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3de82-bd5c-42a3-be2b-71bb250529b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:51.965224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3de82-bd5c-42a3-be2b-71bb250529b2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:51.993473 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 201/405] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:47:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:51.993473 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3de82-bd5c-42a3-be2b-71bb250529b2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:52.048822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c8772-00be-46e2-b529-0d03b9f9eecd None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:52.052505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:52.084998 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65685ed3-0c0a-41fd-9973-b35d4709f855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:52.085905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65685ed3-0c0a-41fd-9973-b35d4709f855 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:52.086166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65685ed3-0c0a-41fd-9973-b35d4709f855 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:52.086440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65685ed3-0c0a-41fd-9973-b35d4709f855 None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:52.087140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65685ed3-0c0a-41fd-9973-b35d4709f855 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:52.087441 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65685ed3-0c0a-41fd-9973-b35d4709f855 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:52.088867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65685ed3-0c0a-41fd-9973-b35d4709f855 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:52.106900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3de82-bd5c-42a3-be2b-71bb250529b2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:52.107075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 205/406] 10.222.0.45 () {56 vars in 1139 bytes} [Mon Oct 31 14:47:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:52.112190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65685ed3-0c0a-41fd-9973-b35d4709f855 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:52.141889 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07902b16-27df-499c-895c-ffb0cec0f04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:52.142492 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07902b16-27df-499c-895c-ffb0cec0f04c None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:52.142763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07902b16-27df-499c-895c-ffb0cec0f04c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:52.143036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07902b16-27df-499c-895c-ffb0cec0f04c None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:52.143674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07902b16-27df-499c-895c-ffb0cec0f04c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:52.145074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07902b16-27df-499c-895c-ffb0cec0f04c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:52.179733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:52.212961 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65685ed3-0c0a-41fd-9973-b35d4709f855 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:52.245843 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbe8d6-d055-4b1f-b02a-461378cd23cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:52.246459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbe8d6-d055-4b1f-b02a-461378cd23cf None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:52.246733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbe8d6-d055-4b1f-b02a-461378cd23cf None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:52.247001 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbe8d6-d055-4b1f-b02a-461378cd23cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:52.256671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbe8d6-d055-4b1f-b02a-461378cd23cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:52.259054 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbe8d6-d055-4b1f-b02a-461378cd23cf None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-d4bbe8d6-d055-4b1f-b02a-461378cd23cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:52.273304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:52.274369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:52.275396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:52.275396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:52.275396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:52.279009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 206/407] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:52.279515 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 202/408] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:47:51 2022] POST /identity/v3/users => generated 247 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:47:52.288624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbe8d6-d055-4b1f-b02a-461378cd23cf None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:52.288761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07902b16-27df-499c-895c-ffb0cec0f04c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:52.426649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07902b16-27df-499c-895c-ffb0cec0f04c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:52.432504 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:52.442050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbe8d6-d055-4b1f-b02a-461378cd23cf None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:52.471478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:52.474060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44abd4e-a358-4737-824f-44ea4a691003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:52.474854 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44abd4e-a358-4737-824f-44ea4a691003 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:52.475263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44abd4e-a358-4737-824f-44ea4a691003 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:52.483258 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44abd4e-a358-4737-824f-44ea4a691003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:52.488750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44abd4e-a358-4737-824f-44ea4a691003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:52.489645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44abd4e-a358-4737-824f-44ea4a691003 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:52.493510 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c9d07-320d-47c7-a232-038cfb8a2e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:52.494343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c9d07-320d-47c7-a232-038cfb8a2e1b None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:52.494761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c9d07-320d-47c7-a232-038cfb8a2e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:52.495166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c9d07-320d-47c7-a232-038cfb8a2e1b None admin] PATH_INFO: `/v3/projects/b82a0373e3b649f3a023efd8db204123/users/74317ae6b47843de85d03f3a9d3a811d/roles/bc1117423b4841a4ae3e7be8f54af3b7` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f44abd4e-a358-4737-824f-44ea4a691003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:52.508658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:52.513992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:52.514826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:52.514826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:52.514826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:52.514826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 203/409] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:52.514826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44abd4e-a358-4737-824f-44ea4a691003 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:52.516811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c9d07-320d-47c7-a232-038cfb8a2e1b None admin] RBAC: Authorizing `identity:create_grant(project_id=b82a0373e3b649f3a023efd8db204123, user_id=74317ae6b47843de85d03f3a9d3a811d, role_id=bc1117423b4841a4ae3e7be8f54af3b7)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:52.518578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c9d07-320d-47c7-a232-038cfb8a2e1b None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:52.611867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 207/410] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:52 2022] PUT /identity/v3/projects/b82a0373e3b649f3a023efd8db204123/users/74317ae6b47843de85d03f3a9d3a811d/roles/bc1117423b4841a4ae3e7be8f54af3b7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:52.615605 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c9d07-320d-47c7-a232-038cfb8a2e1b None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:52.645065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44abd4e-a358-4737-824f-44ea4a691003 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:52.721716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2fa4a-0b85-42b7-9793-504dda208b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:52.722255 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2fa4a-0b85-42b7-9793-504dda208b04 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:52.722534 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2fa4a-0b85-42b7-9793-504dda208b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:52.722806 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2fa4a-0b85-42b7-9793-504dda208b04 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:52.723460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2fa4a-0b85-42b7-9793-504dda208b04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:52.723760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2fa4a-0b85-42b7-9793-504dda208b04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:52.725183 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2fa4a-0b85-42b7-9793-504dda208b04 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:52.755652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 204/411] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:52.761673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2fa4a-0b85-42b7-9793-504dda208b04 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:52.784722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c9d07-320d-47c7-a232-038cfb8a2e1b None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:52.806580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:52.856233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb630c1b-16db-416e-90e0-54ba3f962796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:52.857099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb630c1b-16db-416e-90e0-54ba3f962796 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:52.857569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb630c1b-16db-416e-90e0-54ba3f962796 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:52.857971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb630c1b-16db-416e-90e0-54ba3f962796 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:52.858764 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb630c1b-16db-416e-90e0-54ba3f962796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:52.860808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb630c1b-16db-416e-90e0-54ba3f962796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:52.863819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb630c1b-16db-416e-90e0-54ba3f962796 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:52.880101 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 208/412] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:52.886063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb630c1b-16db-416e-90e0-54ba3f962796 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:52.933683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:52.958139 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2fa4a-0b85-42b7-9793-504dda208b04 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:52.999352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253805d-974e-4a12-b4a2-3f36bed439a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:52.999983 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253805d-974e-4a12-b4a2-3f36bed439a9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:53.000258 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253805d-974e-4a12-b4a2-3f36bed439a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:53.000535 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253805d-974e-4a12-b4a2-3f36bed439a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:53.017657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253805d-974e-4a12-b4a2-3f36bed439a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:53.021262 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253805d-974e-4a12-b4a2-3f36bed439a9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5253805d-974e-4a12-b4a2-3f36bed439a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:47:53.039231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:53.040131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:53.040980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:47:53.040980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:47:53.040980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:47:53.040980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:47:53.040980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:47:53.040980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:47:53.040980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:53.040980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:53.040980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 205/413] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:47:53.046087 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253805d-974e-4a12-b4a2-3f36bed439a9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:53.075361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb630c1b-16db-416e-90e0-54ba3f962796 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:53.112309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bf007-5254-4c44-95c0-04df05179ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:53.112942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bf007-5254-4c44-95c0-04df05179ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:53.113272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bf007-5254-4c44-95c0-04df05179ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:53.113570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bf007-5254-4c44-95c0-04df05179ab0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:53.122140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bf007-5254-4c44-95c0-04df05179ab0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:53.124618 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bf007-5254-4c44-95c0-04df05179ab0 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-7b9bf007-5254-4c44-95c0-04df05179ab0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:47:53.137708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:53.138587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:53.139416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:47:53.139416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:47:53.139416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:47:53.139416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:47:53.139416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:47:53.139416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:47:53.139416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:53.139416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:53.139814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 209/414] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:53.145768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bf007-5254-4c44-95c0-04df05179ab0 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:53.202820 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:53.249675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253805d-974e-4a12-b4a2-3f36bed439a9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:53.312542 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbbe4d-2c15-4e06-8da4-88630c6abd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:53.313205 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbbe4d-2c15-4e06-8da4-88630c6abd83 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:53.317051 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:53.318904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbbe4d-2c15-4e06-8da4-88630c6abd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:53.319406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbbe4d-2c15-4e06-8da4-88630c6abd83 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:53.320871 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbbe4d-2c15-4e06-8da4-88630c6abd83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:53.321571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbbe4d-2c15-4e06-8da4-88630c6abd83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:53.324483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbbe4d-2c15-4e06-8da4-88630c6abd83 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:53.339748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bf007-5254-4c44-95c0-04df05179ab0 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:53.353038 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 206/415] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:47:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:47:53.358704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbbe4d-2c15-4e06-8da4-88630c6abd83 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:53.407509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e1253-0860-4485-9acf-a638a3932187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:53.408477 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e1253-0860-4485-9acf-a638a3932187 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:53.408955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e1253-0860-4485-9acf-a638a3932187 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:53.409535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e1253-0860-4485-9acf-a638a3932187 None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:53.410412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e1253-0860-4485-9acf-a638a3932187 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:53.411606 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e1253-0860-4485-9acf-a638a3932187 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:53.414334 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e1253-0860-4485-9acf-a638a3932187 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:53.435389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 210/416] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:47:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:53.442416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e1253-0860-4485-9acf-a638a3932187 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:53.509932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbbe4d-2c15-4e06-8da4-88630c6abd83 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:53.578941 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8096e0b-cb9c-4881-aeef-20d699cc22d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:53.579606 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096e0b-cb9c-4881-aeef-20d699cc22d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:53.579883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096e0b-cb9c-4881-aeef-20d699cc22d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:53.580153 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096e0b-cb9c-4881-aeef-20d699cc22d9 None admin] PATH_INFO: `/v3/projects/b82a0373e3b649f3a023efd8db204123/users/1277082583d64fc5a37d50f38393a51c/roles/bc1117423b4841a4ae3e7be8f54af3b7` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:53.588618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:53.606766 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e1253-0860-4485-9acf-a638a3932187 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:53.612605 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8096e0b-cb9c-4881-aeef-20d699cc22d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b82a0373e3b649f3a023efd8db204123, user_id=1277082583d64fc5a37d50f38393a51c, role_id=bc1117423b4841a4ae3e7be8f54af3b7)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:53.617474 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8096e0b-cb9c-4881-aeef-20d699cc22d9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:53.648863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cb471-86fa-4a67-a5fc-27d3b995cee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:53.649665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cb471-86fa-4a67-a5fc-27d3b995cee1 None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:53.649993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cb471-86fa-4a67-a5fc-27d3b995cee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:53.650308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cb471-86fa-4a67-a5fc-27d3b995cee1 None admin] PATH_INFO: `/v3/projects/b82a0373e3b649f3a023efd8db204123/users/93815827ae97419abf6fa45fbab185f5/roles/bc1117423b4841a4ae3e7be8f54af3b7` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:53.667592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cb471-86fa-4a67-a5fc-27d3b995cee1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b82a0373e3b649f3a023efd8db204123, user_id=93815827ae97419abf6fa45fbab185f5, role_id=bc1117423b4841a4ae3e7be8f54af3b7)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:53.669025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cb471-86fa-4a67-a5fc-27d3b995cee1 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:53.763527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 207/417] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:53 2022] PUT /identity/v3/projects/b82a0373e3b649f3a023efd8db204123/users/1277082583d64fc5a37d50f38393a51c/roles/bc1117423b4841a4ae3e7be8f54af3b7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:53.807794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:53.813563 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 211/418] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:53 2022] PUT /identity/v3/projects/b82a0373e3b649f3a023efd8db204123/users/93815827ae97419abf6fa45fbab185f5/roles/bc1117423b4841a4ae3e7be8f54af3b7 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:47:53.861852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac15ac-2272-4628-aa9c-7467c6d8b6bf None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:53.862288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac15ac-2272-4628-aa9c-7467c6d8b6bf None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:53.862604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac15ac-2272-4628-aa9c-7467c6d8b6bf None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:53.864611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 208/419] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:53.871159 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87682-bcd7-4566-8fed-d6700f3dda2e None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:53.871942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87682-bcd7-4566-8fed-d6700f3dda2e None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:53.872420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87682-bcd7-4566-8fed-d6700f3dda2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:53.902580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e3e87682-bcd7-4566-8fed-d6700f3dda2e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:53.904209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e3e87682-bcd7-4566-8fed-d6700f3dda2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:53.987842 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 212/420] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:54.415185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac15ac-2272-4628-aa9c-7467c6d8b6bf None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:54.529231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac15ac-2272-4628-aa9c-7467c6d8b6bf None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:54.576242 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1823e-e119-4c9d-aca2-9b75702346bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:54.576864 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1823e-e119-4c9d-aca2-9b75702346bf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:54.577140 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1823e-e119-4c9d-aca2-9b75702346bf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:54.577438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1823e-e119-4c9d-aca2-9b75702346bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:54.595715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1823e-e119-4c9d-aca2-9b75702346bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-42b1823e-e119-4c9d-aca2-9b75702346bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:54.600506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:54.601454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:54.602230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:54.602230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:54.602230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:54.602230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:54.602230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:54.602230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:54.602230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:54.602230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:54.602230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:54.602230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:54.602230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:54.602230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:54.602837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 209/421] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:47:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:54.608077 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e87682-bcd7-4566-8fed-d6700f3dda2e None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:54.733746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e87682-bcd7-4566-8fed-d6700f3dda2e None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:54.769535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:54.780465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b55ee5-f1e8-4eb4-a253-db43c58abda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:54.787491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b55ee5-f1e8-4eb4-a253-db43c58abda6 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:54.787491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b55ee5-f1e8-4eb4-a253-db43c58abda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:54.787491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b55ee5-f1e8-4eb4-a253-db43c58abda6 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:54.787491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b55ee5-f1e8-4eb4-a253-db43c58abda6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:54.787491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b55ee5-f1e8-4eb4-a253-db43c58abda6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:54.787491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b55ee5-f1e8-4eb4-a253-db43c58abda6 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:54.799565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 213/422] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:47:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:54.807053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1823e-e119-4c9d-aca2-9b75702346bf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:54.880605 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:54.938981 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be325e4-569c-41f0-ac13-a1583c509ff4 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:54.939344 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be325e4-569c-41f0-ac13-a1583c509ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:54.939770 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be325e4-569c-41f0-ac13-a1583c509ff4 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:54.941909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 214/423] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:47:54.948542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c878fd-a8bd-4e3d-bf55-bc2537621378 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:54.949143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c878fd-a8bd-4e3d-bf55-bc2537621378 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:54.949643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c878fd-a8bd-4e3d-bf55-bc2537621378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:54.959523 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1823e-e119-4c9d-aca2-9b75702346bf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:54.968518 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-58c878fd-a8bd-4e3d-bf55-bc2537621378 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:54.970010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-58c878fd-a8bd-4e3d-bf55-bc2537621378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:55.023511 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2908a54-ea8f-4898-a4b0-460659b804ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:55.024057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2908a54-ea8f-4898-a4b0-460659b804ca None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.024334 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2908a54-ea8f-4898-a4b0-460659b804ca None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.024600 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2908a54-ea8f-4898-a4b0-460659b804ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.044978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2908a54-ea8f-4898-a4b0-460659b804ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:55.046507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2908a54-ea8f-4898-a4b0-460659b804ca None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f2908a54-ea8f-4898-a4b0-460659b804ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:55.074851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:55.075799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:55.076631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:55.076631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:55.076631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:55.078084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 210/424] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:55.083231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2908a54-ea8f-4898-a4b0-460659b804ca None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:55.108818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 215/425] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:47:55.225902 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:55.233157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2908a54-ea8f-4898-a4b0-460659b804ca None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:55.278785 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c95111-1d59-457d-a577-89b135d21ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:55.279330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c95111-1d59-457d-a577-89b135d21ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.279607 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c95111-1d59-457d-a577-89b135d21ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.280133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c95111-1d59-457d-a577-89b135d21ed7 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.280814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c95111-1d59-457d-a577-89b135d21ed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:55.281115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c95111-1d59-457d-a577-89b135d21ed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:55.282568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c95111-1d59-457d-a577-89b135d21ed7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:55.298524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 211/426] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:55.303900 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c878fd-a8bd-4e3d-bf55-bc2537621378 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:55.432105 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c229-5317-4b2d-bdf1-d5ae6b2b9238 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.432623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c229-5317-4b2d-bdf1-d5ae6b2b9238 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.432710 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c229-5317-4b2d-bdf1-d5ae6b2b9238 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.434098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 212/427] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:47:55.440850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8b321-b8e3-49d3-a075-ae0f3bca7025 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.441196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8b321-b8e3-49d3-a075-ae0f3bca7025 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.441624 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8b321-b8e3-49d3-a075-ae0f3bca7025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.452395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c878fd-a8bd-4e3d-bf55-bc2537621378 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:55.465275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-41a8b321-b8e3-49d3-a075-ae0f3bca7025 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:55.466522 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-41a8b321-b8e3-49d3-a075-ae0f3bca7025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:55.492080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:55.530850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52f673-59a6-4c62-9b81-2ce0e0ab2e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:55.531410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52f673-59a6-4c62-9b81-2ce0e0ab2e74 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.531736 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52f673-59a6-4c62-9b81-2ce0e0ab2e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.532008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52f673-59a6-4c62-9b81-2ce0e0ab2e74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.549611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52f673-59a6-4c62-9b81-2ce0e0ab2e74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:55.551148 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52f673-59a6-4c62-9b81-2ce0e0ab2e74 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:55.553872 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 213/428] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:55.573461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8b321-b8e3-49d3-a075-ae0f3bca7025 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-1d52f673-59a6-4c62-9b81-2ce0e0ab2e74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:47:55.587354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:55.588230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:55.589109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:55.589109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:55.589109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:47:55.589109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:47:55.589109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:47:55.589109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:47:55.589109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:47:55.589109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:47:55.589109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 14:47:55.589109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:55.596197 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 216/429] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 31 14:47:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:55.597081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52f673-59a6-4c62-9b81-2ce0e0ab2e74 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:55.705828 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:55.719214 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8b321-b8e3-49d3-a075-ae0f3bca7025 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:55.758010 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66110c-85e6-4ec6-a324-2c7a0f354297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:55.758639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66110c-85e6-4ec6-a324-2c7a0f354297 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.759207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66110c-85e6-4ec6-a324-2c7a0f354297 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.759399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66110c-85e6-4ec6-a324-2c7a0f354297 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.771925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66110c-85e6-4ec6-a324-2c7a0f354297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5b66110c-85e6-4ec6-a324-2c7a0f354297 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:55.777810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:55.778875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:55.780190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:55.780190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:55.780190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:55.780190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:55.780190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:55.780190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:55.780190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:55.780190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:55.780190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:55.780190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:55.780190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:55.780190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:55.782475 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 214/430] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:47:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:47:55.791527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66110c-85e6-4ec6-a324-2c7a0f354297 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:55.831583 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52f673-59a6-4c62-9b81-2ce0e0ab2e74 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:55.902688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cdde2-9796-4808-bc01-63e094b5d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:55.903838 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cdde2-9796-4808-bc01-63e094b5d669 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.904354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cdde2-9796-4808-bc01-63e094b5d669 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.905094 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cdde2-9796-4808-bc01-63e094b5d669 None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.906275 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cdde2-9796-4808-bc01-63e094b5d669 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:55.907634 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cdde2-9796-4808-bc01-63e094b5d669 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:55.909274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cdde2-9796-4808-bc01-63e094b5d669 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:55.933475 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 217/431] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 31 14:47:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:55.934758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cdde2-9796-4808-bc01-63e094b5d669 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:55.946604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66110c-85e6-4ec6-a324-2c7a0f354297 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:55.993975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:55.997611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a24233-2167-4d89-b84c-5c112464086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:55.998222 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a24233-2167-4d89-b84c-5c112464086b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:55.998499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a24233-2167-4d89-b84c-5c112464086b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:55.998771 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a24233-2167-4d89-b84c-5c112464086b None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:55.999740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a24233-2167-4d89-b84c-5c112464086b None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:56.000044 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a24233-2167-4d89-b84c-5c112464086b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:56.001711 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a24233-2167-4d89-b84c-5c112464086b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:56.016159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 215/432] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:47:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:56.016159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a24233-2167-4d89-b84c-5c112464086b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:56.026477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:56.072971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cdde2-9796-4808-bc01-63e094b5d669 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:56.117749 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b271fbd-750f-4e4a-9dd5-c38e4b9878d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:56.118391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b271fbd-750f-4e4a-9dd5-c38e4b9878d4 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.118625 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b271fbd-750f-4e4a-9dd5-c38e4b9878d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.119164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b271fbd-750f-4e4a-9dd5-c38e4b9878d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.132844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b271fbd-750f-4e4a-9dd5-c38e4b9878d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:56.135909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a24233-2167-4d89-b84c-5c112464086b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-0b271fbd-750f-4e4a-9dd5-c38e4b9878d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:56.139389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:56.140263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:56.141053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:56.141053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:56.141053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:56.141053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:56.141053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:56.141053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:56.141053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:56.141053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:56.141053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:56.141053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:56.141053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:56.141053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:56.145396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 218/433] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:47:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:56.146247 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b271fbd-750f-4e4a-9dd5-c38e4b9878d4 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:56.180226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759aac0-43fe-4394-8fe0-3b661d54585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:56.181218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759aac0-43fe-4394-8fe0-3b661d54585f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.181988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759aac0-43fe-4394-8fe0-3b661d54585f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.183013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759aac0-43fe-4394-8fe0-3b661d54585f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.265773 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:56.269651 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b271fbd-750f-4e4a-9dd5-c38e4b9878d4 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:56.276333 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759aac0-43fe-4394-8fe0-3b661d54585f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:56.278079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759aac0-43fe-4394-8fe0-3b661d54585f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:56.292121 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:56.305674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee986f-39d7-4a23-878d-f202a68d39b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:56.306936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee986f-39d7-4a23-878d-f202a68d39b1 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.307329 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee986f-39d7-4a23-878d-f202a68d39b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.307704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee986f-39d7-4a23-878d-f202a68d39b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.318732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee986f-39d7-4a23-878d-f202a68d39b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:56.320372 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee986f-39d7-4a23-878d-f202a68d39b1 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-0aee986f-39d7-4a23-878d-f202a68d39b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:56.335683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:56.336580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:56.337440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:56.337440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:56.337440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:56.337440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 219/434] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:56.337671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee986f-39d7-4a23-878d-f202a68d39b1 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:56.399609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 216/435] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:56.400914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cef45a-997d-4c8c-9b88-f7d38427d5ff None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.401190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cef45a-997d-4c8c-9b88-f7d38427d5ff None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.401486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cef45a-997d-4c8c-9b88-f7d38427d5ff None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.402981 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 217/436] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:56.403556 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cef45a-997d-4c8c-9b88-f7d38427d5ff None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:56.454314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee986f-39d7-4a23-878d-f202a68d39b1 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:56.489772 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f46fc-43a3-46a0-835f-43ff484f82f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:56.490381 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f46fc-43a3-46a0-835f-43ff484f82f1 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.490651 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f46fc-43a3-46a0-835f-43ff484f82f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.490921 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f46fc-43a3-46a0-835f-43ff484f82f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.491613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f46fc-43a3-46a0-835f-43ff484f82f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:56.491987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f46fc-43a3-46a0-835f-43ff484f82f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:56.493294 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f46fc-43a3-46a0-835f-43ff484f82f1 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:56.502417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 220/437] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:47:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:56.503219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f46fc-43a3-46a0-835f-43ff484f82f1 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:56.518368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:56.520773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cef45a-997d-4c8c-9b88-f7d38427d5ff None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:56.532471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:56.556287 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df300d8-35f2-43b6-9279-2f015ed00e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:56.556899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df300d8-35f2-43b6-9279-2f015ed00e24 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.557178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df300d8-35f2-43b6-9279-2f015ed00e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.557478 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df300d8-35f2-43b6-9279-2f015ed00e24 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.558119 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df300d8-35f2-43b6-9279-2f015ed00e24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:56.558416 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df300d8-35f2-43b6-9279-2f015ed00e24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:56.559768 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df300d8-35f2-43b6-9279-2f015ed00e24 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:56.571573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 218/438] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:56.572754 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4eac-a832-4013-984b-a241c80b5d59 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.573030 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4eac-a832-4013-984b-a241c80b5d59 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.573391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4eac-a832-4013-984b-a241c80b5d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.591394 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b94f4eac-a832-4013-984b-a241c80b5d59 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:56.592516 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b94f4eac-a832-4013-984b-a241c80b5d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:56.606738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f46fc-43a3-46a0-835f-43ff484f82f1 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:56.639154 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82e4ab-02f9-409e-9ad3-1d37493c1483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:56.639774 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82e4ab-02f9-409e-9ad3-1d37493c1483 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.640046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82e4ab-02f9-409e-9ad3-1d37493c1483 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.640310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82e4ab-02f9-409e-9ad3-1d37493c1483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.651087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82e4ab-02f9-409e-9ad3-1d37493c1483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:56.652510 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82e4ab-02f9-409e-9ad3-1d37493c1483 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:56.658226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 219/439] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:56.659045 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4eac-a832-4013-984b-a241c80b5d59 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-1a82e4ab-02f9-409e-9ad3-1d37493c1483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:56.668240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:56.669120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:56.670478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:56.670478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:56.670478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:56.670478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 221/440] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:56.670478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44da4ac-5ab6-4685-84f2-f4863d9cac5b None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.670768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44da4ac-5ab6-4685-84f2-f4863d9cac5b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.671249 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44da4ac-5ab6-4685-84f2-f4863d9cac5b None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.672421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 222/441] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:47:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:47:56.673332 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44da4ac-5ab6-4685-84f2-f4863d9cac5b None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:56.745609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:56.764510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:56.767478 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4eac-a832-4013-984b-a241c80b5d59 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:56.784736 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44da4ac-5ab6-4685-84f2-f4863d9cac5b None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:56.802492 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bdc6b-9dcd-4a27-a605-d08d7c2ec29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:56.803111 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bdc6b-9dcd-4a27-a605-d08d7c2ec29f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.803384 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bdc6b-9dcd-4a27-a605-d08d7c2ec29f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.803649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bdc6b-9dcd-4a27-a605-d08d7c2ec29f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.814411 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bdc6b-9dcd-4a27-a605-d08d7c2ec29f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:56.815850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bdc6b-9dcd-4a27-a605-d08d7c2ec29f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:56.819429 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7613b-2e1a-4ede-aa77-b5e78fe9e0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:56.820629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7613b-2e1a-4ede-aa77-b5e78fe9e0dc None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.820904 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7613b-2e1a-4ede-aa77-b5e78fe9e0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.821171 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7613b-2e1a-4ede-aa77-b5e78fe9e0dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.828748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7613b-2e1a-4ede-aa77-b5e78fe9e0dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:56.830212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7613b-2e1a-4ede-aa77-b5e78fe9e0dc None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c09bdc6b-9dcd-4a27-a605-d08d7c2ec29f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:56.834006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:56.835399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:56.836518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:56.836518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:56.836518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-87e7613b-2e1a-4ede-aa77-b5e78fe9e0dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:47:56.841708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:56.843209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:56.845314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:56.845314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:56.845314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:47:56.845314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:47:56.845314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:47:56.845314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:47:56.845314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:47:56.845314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:47:56.845314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 14:47:56.845314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:56.846621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 220/442] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:56.846621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bdc6b-9dcd-4a27-a605-d08d7c2ec29f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:56.847435 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 223/443] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:47:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:56.848538 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894acff-5e09-49f6-b4b6-a995ab5555b8 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.848817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894acff-5e09-49f6-b4b6-a995ab5555b8 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.849085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894acff-5e09-49f6-b4b6-a995ab5555b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.868281 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-6894acff-5e09-49f6-b4b6-a995ab5555b8 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:47:56.869690 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6894acff-5e09-49f6-b4b6-a995ab5555b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:47:56.938481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 224/444] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:47:56.939870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894acff-5e09-49f6-b4b6-a995ab5555b8 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:56.953183 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bdc6b-9dcd-4a27-a605-d08d7c2ec29f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:56.997611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc57d7-7af6-4189-b398-f6126de50037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:56.998221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc57d7-7af6-4189-b398-f6126de50037 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:56.998502 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc57d7-7af6-4189-b398-f6126de50037 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:56.998773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc57d7-7af6-4189-b398-f6126de50037 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:56.999412 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc57d7-7af6-4189-b398-f6126de50037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:56.999710 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc57d7-7af6-4189-b398-f6126de50037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.000006 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:57.001257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc57d7-7af6-4189-b398-f6126de50037 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.018090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 221/445] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:57.018833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc57d7-7af6-4189-b398-f6126de50037 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.034640 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:57.049965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894acff-5e09-49f6-b4b6-a995ab5555b8 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.086052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2c38f-41f2-46d9-92b3-e18818a9120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.086924 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2c38f-41f2-46d9-92b3-e18818a9120c None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.087338 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2c38f-41f2-46d9-92b3-e18818a9120c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.087697 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2c38f-41f2-46d9-92b3-e18818a9120c None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.088339 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2c38f-41f2-46d9-92b3-e18818a9120c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:57.088634 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2c38f-41f2-46d9-92b3-e18818a9120c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.090054 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2c38f-41f2-46d9-92b3-e18818a9120c None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.102171 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 225/446] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:57.102892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2c38f-41f2-46d9-92b3-e18818a9120c None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.132700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc57d7-7af6-4189-b398-f6126de50037 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.169751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cde5e-97f6-4183-8865-ca8b1951096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.170377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cde5e-97f6-4183-8865-ca8b1951096d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.170652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cde5e-97f6-4183-8865-ca8b1951096d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.170921 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cde5e-97f6-4183-8865-ca8b1951096d None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.171634 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cde5e-97f6-4183-8865-ca8b1951096d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:57.171929 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cde5e-97f6-4183-8865-ca8b1951096d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.173484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cde5e-97f6-4183-8865-ca8b1951096d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.209942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2c38f-41f2-46d9-92b3-e18818a9120c None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.216171 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 222/447] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:57.216171 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cde5e-97f6-4183-8865-ca8b1951096d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.229379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:57.249332 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6770c99-a049-4242-8a28-89b3f1b8dba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.249932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6770c99-a049-4242-8a28-89b3f1b8dba4 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.250199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6770c99-a049-4242-8a28-89b3f1b8dba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.250464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6770c99-a049-4242-8a28-89b3f1b8dba4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.260977 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6770c99-a049-4242-8a28-89b3f1b8dba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-d6770c99-a049-4242-8a28-89b3f1b8dba4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:57.266130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:57.267186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 226/448] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:57.268501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6770c99-a049-4242-8a28-89b3f1b8dba4 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.285438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:57.316449 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cde5e-97f6-4183-8865-ca8b1951096d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.351827 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e6a9b-7aee-4b8f-a5da-56733c97a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.352522 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e6a9b-7aee-4b8f-a5da-56733c97a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.352738 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e6a9b-7aee-4b8f-a5da-56733c97a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.353004 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e6a9b-7aee-4b8f-a5da-56733c97a7c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.360760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e6a9b-7aee-4b8f-a5da-56733c97a7c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.362241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e6a9b-7aee-4b8f-a5da-56733c97a7c6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.366172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6770c99-a049-4242-8a28-89b3f1b8dba4 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f95e6a9b-7aee-4b8f-a5da-56733c97a7c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:47:57.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:57.374735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:57.375586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:47:57.375586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:47:57.375586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:47:57.375586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:47:57.375586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:47:57.375586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:47:57.375586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:57.375586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:57.375586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 223/449] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:57.376037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e6a9b-7aee-4b8f-a5da-56733c97a7c6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.401248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50acb4d-d23f-40d7-b65c-a2585ab17a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.401889 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50acb4d-d23f-40d7-b65c-a2585ab17a57 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.402165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50acb4d-d23f-40d7-b65c-a2585ab17a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.402434 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50acb4d-d23f-40d7-b65c-a2585ab17a57 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.410059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50acb4d-d23f-40d7-b65c-a2585ab17a57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.411479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50acb4d-d23f-40d7-b65c-a2585ab17a57 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-e50acb4d-d23f-40d7-b65c-a2585ab17a57 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:47:57.422458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:57.423512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:57.424542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:57.424542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:57.424542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:47:57.424542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:47:57.424542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:47:57.424542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:47:57.424542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:47:57.424542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:47:57.424542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 31 14:47:57.424542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:57.424542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 227/450] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:57.424542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50acb4d-d23f-40d7-b65c-a2585ab17a57 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.461705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:57.479600 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e6a9b-7aee-4b8f-a5da-56733c97a7c6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.505813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:57.511115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0d4d0-2dd7-4c8d-97c4-6eab2d286575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.511733 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0d4d0-2dd7-4c8d-97c4-6eab2d286575 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.512004 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0d4d0-2dd7-4c8d-97c4-6eab2d286575 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.512266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0d4d0-2dd7-4c8d-97c4-6eab2d286575 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.522549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0d4d0-2dd7-4c8d-97c4-6eab2d286575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:47:57.526521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50acb4d-d23f-40d7-b65c-a2585ab17a57 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-7ef0d4d0-2dd7-4c8d-97c4-6eab2d286575 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:47:57.528476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:57.529377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:57.530420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:57.530420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:57.530420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:57.530420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:57.530420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:47:57.530420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:47:57.530420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:47:57.530420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:47:57.530420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:47:57.530420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:47:57.530420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:47:57.530420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:57.530420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 224/451] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:57.531074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0d4d0-2dd7-4c8d-97c4-6eab2d286575 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.564118 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ebb2a-6d4a-4845-bfde-f21dbe9b51c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.564737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ebb2a-6d4a-4845-bfde-f21dbe9b51c6 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.565012 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ebb2a-6d4a-4845-bfde-f21dbe9b51c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.565303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ebb2a-6d4a-4845-bfde-f21dbe9b51c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.575691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ebb2a-6d4a-4845-bfde-f21dbe9b51c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.577122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ebb2a-6d4a-4845-bfde-f21dbe9b51c6 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-f32ebb2a-6d4a-4845-bfde-f21dbe9b51c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:57.591526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:57.592448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:57.593269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:57.593269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:57.593269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:57.593269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 228/452] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:57.593521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ebb2a-6d4a-4845-bfde-f21dbe9b51c6 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.633905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0d4d0-2dd7-4c8d-97c4-6eab2d286575 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.667027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f506206-3425-47a9-b3d0-6f6c8fbd0288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.667622 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f506206-3425-47a9-b3d0-6f6c8fbd0288 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.667903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f506206-3425-47a9-b3d0-6f6c8fbd0288 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.668174 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f506206-3425-47a9-b3d0-6f6c8fbd0288 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.668830 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f506206-3425-47a9-b3d0-6f6c8fbd0288 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:57.669132 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f506206-3425-47a9-b3d0-6f6c8fbd0288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.670528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f506206-3425-47a9-b3d0-6f6c8fbd0288 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.676157 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:57.678434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 225/453] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:57.679731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f506206-3425-47a9-b3d0-6f6c8fbd0288 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.691421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ebb2a-6d4a-4845-bfde-f21dbe9b51c6 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.724384 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d471-5195-44b1-ac8a-e8d32be3c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.724980 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d471-5195-44b1-ac8a-e8d32be3c6db None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.725257 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d471-5195-44b1-ac8a-e8d32be3c6db None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.725552 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d471-5195-44b1-ac8a-e8d32be3c6db None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.726509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5d471-5195-44b1-ac8a-e8d32be3c6db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:57.726828 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5d471-5195-44b1-ac8a-e8d32be3c6db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.728257 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5d471-5195-44b1-ac8a-e8d32be3c6db None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.731894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:57.740718 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 229/454] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:57.741535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d471-5195-44b1-ac8a-e8d32be3c6db None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.777791 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f506206-3425-47a9-b3d0-6f6c8fbd0288 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.811971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b7e70-1d65-4970-9972-1b627221bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.812567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b7e70-1d65-4970-9972-1b627221bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.812842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b7e70-1d65-4970-9972-1b627221bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.813112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b7e70-1d65-4970-9972-1b627221bbb5 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.813862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b7e70-1d65-4970-9972-1b627221bbb5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:57.814164 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b7e70-1d65-4970-9972-1b627221bbb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.815571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b7e70-1d65-4970-9972-1b627221bbb5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.832813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 226/455] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:57.833739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b7e70-1d65-4970-9972-1b627221bbb5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.839763 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d471-5195-44b1-ac8a-e8d32be3c6db None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.877226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4d11d-04ba-403e-9d12-8e13a7c1b3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:57.880974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4d11d-04ba-403e-9d12-8e13a7c1b3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:57.880974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4d11d-04ba-403e-9d12-8e13a7c1b3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:57.880974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4d11d-04ba-403e-9d12-8e13a7c1b3a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:57.880974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4d11d-04ba-403e-9d12-8e13a7c1b3a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:57.880974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4d11d-04ba-403e-9d12-8e13a7c1b3a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:57.881891 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4d11d-04ba-403e-9d12-8e13a7c1b3a2 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:57.890018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 230/456] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:57.890757 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4d11d-04ba-403e-9d12-8e13a7c1b3a2 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:57.901513 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:57.981575 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b7e70-1d65-4970-9972-1b627221bbb5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:57.992795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:57.993869 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4d11d-04ba-403e-9d12-8e13a7c1b3a2 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.015544 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f68a-7f6a-4799-9beb-a0230daa51a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.016145 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f68a-7f6a-4799-9beb-a0230daa51a3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.018540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f68a-7f6a-4799-9beb-a0230daa51a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.018540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f6f68a-7f6a-4799-9beb-a0230daa51a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.018540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6f68a-7f6a-4799-9beb-a0230daa51a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:58.018540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6f68a-7f6a-4799-9beb-a0230daa51a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.019006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f6f68a-7f6a-4799-9beb-a0230daa51a3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.026421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5133b0-0a43-4021-b696-394b6e9a6a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.027039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5133b0-0a43-4021-b696-394b6e9a6a38 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.027325 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5133b0-0a43-4021-b696-394b6e9a6a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.027575 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5133b0-0a43-4021-b696-394b6e9a6a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.030142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 227/457] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:58.030926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f68a-7f6a-4799-9beb-a0230daa51a3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.039840 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5133b0-0a43-4021-b696-394b6e9a6a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.041280 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5133b0-0a43-4021-b696-394b6e9a6a38 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-5d5133b0-0a43-4021-b696-394b6e9a6a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:58.056932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:58.057941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:58.058827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:58.058827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:58.058827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:58.058827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 231/458] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:58.059162 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5133b0-0a43-4021-b696-394b6e9a6a38 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.118705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:58.136568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f6f68a-7f6a-4799-9beb-a0230daa51a3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.160233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5133b0-0a43-4021-b696-394b6e9a6a38 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.169983 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f519280-d1c1-41e8-8700-6ac020254111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.170584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f519280-d1c1-41e8-8700-6ac020254111 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.170859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f519280-d1c1-41e8-8700-6ac020254111 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.171128 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f519280-d1c1-41e8-8700-6ac020254111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.171835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f519280-d1c1-41e8-8700-6ac020254111 None admin] RBAC: Adding query filter params (role.id=bc1117423b4841a4ae3e7be8f54af3b7, scope.project.id=b82a0373e3b649f3a023efd8db204123, user.id=9ec30e419d6f4fddb05c4bb08f2ce3f0) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:58.172133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f519280-d1c1-41e8-8700-6ac020254111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.173585 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f519280-d1c1-41e8-8700-6ac020254111 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.179682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 228/459] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/role_assignments?user.id=9ec30e419d6f4fddb05c4bb08f2ce3f0&scope.project.id=b82a0373e3b649f3a023efd8db204123&role.id=bc1117423b4841a4ae3e7be8f54af3b7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:58.180443 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f519280-d1c1-41e8-8700-6ac020254111 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.196605 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc07d12-1bd6-416d-bb57-916c613dc80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.197616 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc07d12-1bd6-416d-bb57-916c613dc80e None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.197892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc07d12-1bd6-416d-bb57-916c613dc80e None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.198164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc07d12-1bd6-416d-bb57-916c613dc80e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.231680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:58.276422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc07d12-1bd6-416d-bb57-916c613dc80e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.277934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc07d12-1bd6-416d-bb57-916c613dc80e None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.306477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f519280-d1c1-41e8-8700-6ac020254111 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.343866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:58.348263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240da97-7ade-4231-9532-735ca55b8874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.349181 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240da97-7ade-4231-9532-735ca55b8874 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.349696 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240da97-7ade-4231-9532-735ca55b8874 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.349971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240da97-7ade-4231-9532-735ca55b8874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.362674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240da97-7ade-4231-9532-735ca55b8874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.364682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240da97-7ade-4231-9532-735ca55b8874 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-e240da97-7ade-4231-9532-735ca55b8874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:58.381578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:58.382583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:58.383441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:58.383441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:58.383441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:58.383441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 229/460] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:58.383655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240da97-7ade-4231-9532-735ca55b8874 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.393469 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 232/461] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:58.393469 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc07d12-1bd6-416d-bb57-916c613dc80e None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.486303 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:58.500092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc07d12-1bd6-416d-bb57-916c613dc80e None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.504937 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240da97-7ade-4231-9532-735ca55b8874 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.537018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a7ce8-fda8-4f2c-bc11-a1931f97d775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.537751 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a7ce8-fda8-4f2c-bc11-a1931f97d775 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.538033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a7ce8-fda8-4f2c-bc11-a1931f97d775 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.538309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a7ce8-fda8-4f2c-bc11-a1931f97d775 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.539563 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a7ce8-fda8-4f2c-bc11-a1931f97d775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:58.539868 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a7ce8-fda8-4f2c-bc11-a1931f97d775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.541308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a7ce8-fda8-4f2c-bc11-a1931f97d775 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.543083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d408a-115b-4aca-8465-e35bd9c60cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.544042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d408a-115b-4aca-8465-e35bd9c60cff None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.544042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d408a-115b-4aca-8465-e35bd9c60cff None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.544279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d408a-115b-4aca-8465-e35bd9c60cff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.551152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d408a-115b-4aca-8465-e35bd9c60cff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.552571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d408a-115b-4aca-8465-e35bd9c60cff None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.557798 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 233/462] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:58.557798 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a7ce8-fda8-4f2c-bc11-a1931f97d775 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-942d408a-115b-4aca-8465-e35bd9c60cff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:47:58.568860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:58.570341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:58.571202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:47:58.571202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:47:58.571202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:47:58.571202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:47:58.571202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:47:58.571202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:47:58.571202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:58.571202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:58.571202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 230/463] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:58.572270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d408a-115b-4aca-8465-e35bd9c60cff None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.584432 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:58.666411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a7ce8-fda8-4f2c-bc11-a1931f97d775 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.680700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d408a-115b-4aca-8465-e35bd9c60cff None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.701681 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d59ce9-0752-49cd-ba76-aa5732cbe96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.702649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d59ce9-0752-49cd-ba76-aa5732cbe96a None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.703121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d59ce9-0752-49cd-ba76-aa5732cbe96a None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.704001 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d59ce9-0752-49cd-ba76-aa5732cbe96a None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.705117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d59ce9-0752-49cd-ba76-aa5732cbe96a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:58.705643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d59ce9-0752-49cd-ba76-aa5732cbe96a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.707944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d59ce9-0752-49cd-ba76-aa5732cbe96a None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.717742 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033ce5f-12ac-4d13-a01c-fe1e1352bf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.718797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033ce5f-12ac-4d13-a01c-fe1e1352bf17 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.719223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033ce5f-12ac-4d13-a01c-fe1e1352bf17 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.719566 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033ce5f-12ac-4d13-a01c-fe1e1352bf17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.725412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 234/464] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:58.725412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d59ce9-0752-49cd-ba76-aa5732cbe96a None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.737146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033ce5f-12ac-4d13-a01c-fe1e1352bf17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.738564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033ce5f-12ac-4d13-a01c-fe1e1352bf17 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.746356 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-e033ce5f-12ac-4d13-a01c-fe1e1352bf17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:47:58.755503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:58.766808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:47:58.767647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:47:58.767647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:47:58.767647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:58.767647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 231/465] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:58.767647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033ce5f-12ac-4d13-a01c-fe1e1352bf17 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.813164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:58.832905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d59ce9-0752-49cd-ba76-aa5732cbe96a None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.867006 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51bd6c-fc97-45f2-a8f6-79d1b36d09f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.867631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51bd6c-fc97-45f2-a8f6-79d1b36d09f2 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.867902 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51bd6c-fc97-45f2-a8f6-79d1b36d09f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.868165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51bd6c-fc97-45f2-a8f6-79d1b36d09f2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.868274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033ce5f-12ac-4d13-a01c-fe1e1352bf17 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:58.875495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51bd6c-fc97-45f2-a8f6-79d1b36d09f2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.876928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51bd6c-fc97-45f2-a8f6-79d1b36d09f2 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-ca51bd6c-fc97-45f2-a8f6-79d1b36d09f2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:47:58.889225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:58.890173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:58.891070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:58.891070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:58.891070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:47:58.891070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:47:58.891070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:47:58.891070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:47:58.891070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:47:58.891070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:47:58.891070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 31 14:47:58.891070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:58.891070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 235/466] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:58.891070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51bd6c-fc97-45f2-a8f6-79d1b36d09f2 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:58.909976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85385d-85e2-4f3b-ae09-818568b02d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:58.910692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85385d-85e2-4f3b-ae09-818568b02d8c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:58.910971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85385d-85e2-4f3b-ae09-818568b02d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:58.911245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85385d-85e2-4f3b-ae09-818568b02d8c None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:58.911934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85385d-85e2-4f3b-ae09-818568b02d8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:58.912238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85385d-85e2-4f3b-ae09-818568b02d8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:58.913893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85385d-85e2-4f3b-ae09-818568b02d8c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:58.932899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 232/467] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:58.933789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85385d-85e2-4f3b-ae09-818568b02d8c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.000020 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:59.000407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51bd6c-fc97-45f2-a8f6-79d1b36d09f2 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:59.035686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac508b9-8e74-4e3f-a6fa-ab97122fc998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:59.036314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac508b9-8e74-4e3f-a6fa-ab97122fc998 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:59.036585 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac508b9-8e74-4e3f-a6fa-ab97122fc998 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:59.036845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac508b9-8e74-4e3f-a6fa-ab97122fc998 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:59.045613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac508b9-8e74-4e3f-a6fa-ab97122fc998 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:59.046823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85385d-85e2-4f3b-ae09-818568b02d8c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:59.047521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac508b9-8e74-4e3f-a6fa-ab97122fc998 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.051756 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-6ac508b9-8e74-4e3f-a6fa-ab97122fc998 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:47:59.063454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:59.064524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:59.065540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:59.065540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:59.065540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:47:59.065540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:47:59.065540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:47:59.065540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:47:59.065540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:47:59.065540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:47:59.065540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 14:47:59.065540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:47:59.067297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 236/468] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:59.068210 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac508b9-8e74-4e3f-a6fa-ab97122fc998 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.087675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef25597-3d4e-4dc1-8254-17cab587c5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:59.088283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef25597-3d4e-4dc1-8254-17cab587c5af None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:59.088563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef25597-3d4e-4dc1-8254-17cab587c5af None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:59.088829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef25597-3d4e-4dc1-8254-17cab587c5af None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:59.089505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef25597-3d4e-4dc1-8254-17cab587c5af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:59.089804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef25597-3d4e-4dc1-8254-17cab587c5af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:59.091167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef25597-3d4e-4dc1-8254-17cab587c5af None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.103371 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 233/469] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:59.104164 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef25597-3d4e-4dc1-8254-17cab587c5af None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.194269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac508b9-8e74-4e3f-a6fa-ab97122fc998 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:59.209891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef25597-3d4e-4dc1-8254-17cab587c5af None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:59.226530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:59.231710 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe97819-8843-41e3-b8fe-8f2beda27924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:59.232309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe97819-8843-41e3-b8fe-8f2beda27924 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:59.232584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe97819-8843-41e3-b8fe-8f2beda27924 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:59.232859 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe97819-8843-41e3-b8fe-8f2beda27924 None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:59.233681 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe97819-8843-41e3-b8fe-8f2beda27924 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:59.233984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe97819-8843-41e3-b8fe-8f2beda27924 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:59.235410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe97819-8843-41e3-b8fe-8f2beda27924 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.244366 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35087261-10b5-4730-a9b5-1e5c8804f47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:59.246585 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35087261-10b5-4730-a9b5-1e5c8804f47b None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:59.246585 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35087261-10b5-4730-a9b5-1e5c8804f47b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:59.246585 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35087261-10b5-4730-a9b5-1e5c8804f47b None admin] PATH_INFO: `/v3/projects/b82a0373e3b649f3a023efd8db204123/users/93cb8e24b84d4c26bf5fd58d93ebb6c4/roles/bc1117423b4841a4ae3e7be8f54af3b7` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:59.253681 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 237/470] 10.222.0.45 () {56 vars in 1139 bytes} [Mon Oct 31 14:47:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:59.254483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe97819-8843-41e3-b8fe-8f2beda27924 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.264943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35087261-10b5-4730-a9b5-1e5c8804f47b None admin] RBAC: Authorizing `identity:create_grant(project_id=b82a0373e3b649f3a023efd8db204123, user_id=93cb8e24b84d4c26bf5fd58d93ebb6c4, role_id=bc1117423b4841a4ae3e7be8f54af3b7)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:59.267835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35087261-10b5-4730-a9b5-1e5c8804f47b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.313996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:59.354387 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe97819-8843-41e3-b8fe-8f2beda27924 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:59.360618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 234/471] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:47:59 2022] PUT /identity/v3/projects/b82a0373e3b649f3a023efd8db204123/users/93cb8e24b84d4c26bf5fd58d93ebb6c4/roles/bc1117423b4841a4ae3e7be8f54af3b7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:47:59.370051 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35087261-10b5-4730-a9b5-1e5c8804f47b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.392176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f1da6-438a-476f-a747-d67a1c0d992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:59.392797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f1da6-438a-476f-a747-d67a1c0d992f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:59.393071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f1da6-438a-476f-a747-d67a1c0d992f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:59.393569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f1da6-438a-476f-a747-d67a1c0d992f None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:59.394106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f1da6-438a-476f-a747-d67a1c0d992f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:47:59.394402 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f1da6-438a-476f-a747-d67a1c0d992f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:59.395855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f1da6-438a-476f-a747-d67a1c0d992f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.428776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 238/472] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Oct 31 14:47:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:47:59.430622 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f1da6-438a-476f-a747-d67a1c0d992f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.546648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35087261-10b5-4730-a9b5-1e5c8804f47b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:59.557193 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f1da6-438a-476f-a747-d67a1c0d992f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:59.575873 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:59.595106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e13da8-0475-407b-bc4f-68ef6487cc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:59.595715 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e13da8-0475-407b-bc4f-68ef6487cc5e None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:59.595987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e13da8-0475-407b-bc4f-68ef6487cc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:59.596251 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e13da8-0475-407b-bc4f-68ef6487cc5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:59.603948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c55594-e010-4149-8570-b737dd473c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:59.605257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c55594-e010-4149-8570-b737dd473c23 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:59.605804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c55594-e010-4149-8570-b737dd473c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:59.606265 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c55594-e010-4149-8570-b737dd473c23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:59.615969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c55594-e010-4149-8570-b737dd473c23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:59.618682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c55594-e010-4149-8570-b737dd473c23 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-25c55594-e010-4149-8570-b737dd473c23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:47:59.635520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:47:59.636391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:47:59.637209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:47:59.637209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:47:59.637209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:47:59.637209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:47:59.637209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:47:59.637209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:47:59.637209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:47:59.637209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:47:59.643467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 235/473] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:47:59.643467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c55594-e010-4149-8570-b737dd473c23 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.674491 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:59.681965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e13da8-0475-407b-bc4f-68ef6487cc5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:59.684469 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e13da8-0475-407b-bc4f-68ef6487cc5e None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.749182 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c55594-e010-4149-8570-b737dd473c23 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:47:59.785884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7560a-9d7b-4cea-91b9-1957057aab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:47:59.786488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7560a-9d7b-4cea-91b9-1957057aab19 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:47:59.786769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7560a-9d7b-4cea-91b9-1957057aab19 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:47:59.787043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7560a-9d7b-4cea-91b9-1957057aab19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:47:59.817370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 239/474] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:47:59.818437 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e13da8-0475-407b-bc4f-68ef6487cc5e None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:47:59.843087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:59.867031 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7560a-9d7b-4cea-91b9-1957057aab19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:47:59.868655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7560a-9d7b-4cea-91b9-1957057aab19 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:47:59.963283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:47:59.964234 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e13da8-0475-407b-bc4f-68ef6487cc5e None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:00.013088 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586e5d3-925d-4cf5-b6a7-eb387f04ecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:00.014067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586e5d3-925d-4cf5-b6a7-eb387f04ecfe None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.014541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586e5d3-925d-4cf5-b6a7-eb387f04ecfe None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.015005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586e5d3-925d-4cf5-b6a7-eb387f04ecfe None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.016024 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586e5d3-925d-4cf5-b6a7-eb387f04ecfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:00.016591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586e5d3-925d-4cf5-b6a7-eb387f04ecfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:00.018230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586e5d3-925d-4cf5-b6a7-eb387f04ecfe None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:00.031692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 240/475] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:00.032762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586e5d3-925d-4cf5-b6a7-eb387f04ecfe None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:00.059764 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 236/476] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:47:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:00.060935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7560a-9d7b-4cea-91b9-1957057aab19 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:00.128196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:00.154124 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586e5d3-925d-4cf5-b6a7-eb387f04ecfe None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:00.169309 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7560a-9d7b-4cea-91b9-1957057aab19 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:00.190449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb74fdd-4ea9-44da-8310-69afc7b44c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:00.191400 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb74fdd-4ea9-44da-8310-69afc7b44c63 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.191888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb74fdd-4ea9-44da-8310-69afc7b44c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.192372 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb74fdd-4ea9-44da-8310-69afc7b44c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.197417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:00.205559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d612f-e6a1-4c44-a8ac-5688ac2e08db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:00.206161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d612f-e6a1-4c44-a8ac-5688ac2e08db None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.206441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d612f-e6a1-4c44-a8ac-5688ac2e08db None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.206806 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d612f-e6a1-4c44-a8ac-5688ac2e08db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.207066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb74fdd-4ea9-44da-8310-69afc7b44c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:00.207595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d612f-e6a1-4c44-a8ac-5688ac2e08db None admin] RBAC: Adding query filter params (role.id=bc1117423b4841a4ae3e7be8f54af3b7, scope.project.id=b82a0373e3b649f3a023efd8db204123, user.id=74317ae6b47843de85d03f3a9d3a811d) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:00.207904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d612f-e6a1-4c44-a8ac-5688ac2e08db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:00.209070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb74fdd-4ea9-44da-8310-69afc7b44c63 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:00.209332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d612f-e6a1-4c44-a8ac-5688ac2e08db None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:00.221341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 237/477] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:48:00 2022] GET /identity/v3/role_assignments?user.id=74317ae6b47843de85d03f3a9d3a811d&scope.project.id=b82a0373e3b649f3a023efd8db204123&role.id=bc1117423b4841a4ae3e7be8f54af3b7 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:00.221341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d612f-e6a1-4c44-a8ac-5688ac2e08db None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-5fb74fdd-4ea9-44da-8310-69afc7b44c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:00.239596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:00.240699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:00.241626 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:00.241626 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:00.241626 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:00.244753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 241/478] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:00.250049 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb74fdd-4ea9-44da-8310-69afc7b44c63 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:00.326826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d612f-e6a1-4c44-a8ac-5688ac2e08db None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:00.366875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a41cbe-2dbb-4734-ae11-e8e28eaab615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:00.367532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a41cbe-2dbb-4734-ae11-e8e28eaab615 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.367834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a41cbe-2dbb-4734-ae11-e8e28eaab615 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.368109 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a41cbe-2dbb-4734-ae11-e8e28eaab615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.373425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb74fdd-4ea9-44da-8310-69afc7b44c63 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:00.380331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a41cbe-2dbb-4734-ae11-e8e28eaab615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:00.381752 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a41cbe-2dbb-4734-ae11-e8e28eaab615 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f2a41cbe-2dbb-4734-ae11-e8e28eaab615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:00.398623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:00.399681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:00.401025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:00.401025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:00.401025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:00.401025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 238/479] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:00.406354 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a41cbe-2dbb-4734-ae11-e8e28eaab615 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:00.410241 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:00.420064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424236e-4e72-4745-b932-e430f50440c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:00.420518 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424236e-4e72-4745-b932-e430f50440c8 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.425635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424236e-4e72-4745-b932-e430f50440c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.425635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424236e-4e72-4745-b932-e430f50440c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.425635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424236e-4e72-4745-b932-e430f50440c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:00.425635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424236e-4e72-4745-b932-e430f50440c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:00.425635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424236e-4e72-4745-b932-e430f50440c8 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:00.443525 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 242/480] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:00.445382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424236e-4e72-4745-b932-e430f50440c8 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:00.471601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:00.537675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a41cbe-2dbb-4734-ae11-e8e28eaab615 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:00.565935 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424236e-4e72-4745-b932-e430f50440c8 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:00.579763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5237d-a9ac-431b-b70b-eb3da5064eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:00.580582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5237d-a9ac-431b-b70b-eb3da5064eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.580687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5237d-a9ac-431b-b70b-eb3da5064eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.580914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5237d-a9ac-431b-b70b-eb3da5064eb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.581559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5237d-a9ac-431b-b70b-eb3da5064eb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:00.581853 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5237d-a9ac-431b-b70b-eb3da5064eb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:00.583390 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5237d-a9ac-431b-b70b-eb3da5064eb7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:00.597612 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 239/481] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:00.598843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc2a39-b806-4f9a-9f55-d902c5f8abe1 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.599190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc2a39-b806-4f9a-9f55-d902c5f8abe1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.599460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc2a39-b806-4f9a-9f55-d902c5f8abe1 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.601089 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 240/482] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:00.604097 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc2a39-b806-4f9a-9f55-d902c5f8abe1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:00.612852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababdf91-c383-4f61-8539-de096e3e237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:00.613505 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababdf91-c383-4f61-8539-de096e3e237f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.613778 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababdf91-c383-4f61-8539-de096e3e237f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.614040 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababdf91-c383-4f61-8539-de096e3e237f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.622167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababdf91-c383-4f61-8539-de096e3e237f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:00.623614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababdf91-c383-4f61-8539-de096e3e237f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-ababdf91-c383-4f61-8539-de096e3e237f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:00.639459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:00.640413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:00.641235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:00.641235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:00.641235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:00.641235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:00.641235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:00.641235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:00.641235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:00.641235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:00.641235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 243/483] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:00.645309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0caa0-de97-40a1-ac9a-dba344d21e3a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.645309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0caa0-de97-40a1-ac9a-dba344d21e3a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.645309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0caa0-de97-40a1-ac9a-dba344d21e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.664012 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-40b0caa0-de97-40a1-ac9a-dba344d21e3a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:00.665931 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-40b0caa0-de97-40a1-ac9a-dba344d21e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:00.721482 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:00.726011 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc2a39-b806-4f9a-9f55-d902c5f8abe1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:00.729252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:00.747151 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 244/484] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:48:00.748167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0caa0-de97-40a1-ac9a-dba344d21e3a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:00.768589 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407a87b-8b27-4702-909f-07881e65b812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:00.770144 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407a87b-8b27-4702-909f-07881e65b812 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.770645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407a87b-8b27-4702-909f-07881e65b812 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.771333 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407a87b-8b27-4702-909f-07881e65b812 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.780132 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407a87b-8b27-4702-909f-07881e65b812 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:00.781888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407a87b-8b27-4702-909f-07881e65b812 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8407a87b-8b27-4702-909f-07881e65b812 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:00.799904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:00.800813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:00.801724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:00.801724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:00.801724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:00.801724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:00.801724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:00.801724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:00.801724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:00.801724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:00.805240 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 241/485] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:00.814299 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407a87b-8b27-4702-909f-07881e65b812 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:00.920375 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0caa0-de97-40a1-ac9a-dba344d21e3a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:00.973219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407a87b-8b27-4702-909f-07881e65b812 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:00.996799 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c037d40-8c8a-41b6-91f9-666586336efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:00.997842 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c037d40-8c8a-41b6-91f9-666586336efb None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:00.998119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c037d40-8c8a-41b6-91f9-666586336efb None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:00.998383 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c037d40-8c8a-41b6-91f9-666586336efb None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:00.999078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c037d40-8c8a-41b6-91f9-666586336efb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:00.999377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c037d40-8c8a-41b6-91f9-666586336efb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:01.000798 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c037d40-8c8a-41b6-91f9-666586336efb None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:01.025519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 245/486] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:48:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:01.028682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f38808-13d1-4cfd-92fc-c3d05d3ab2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:01.029302 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f38808-13d1-4cfd-92fc-c3d05d3ab2cf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:01.029586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f38808-13d1-4cfd-92fc-c3d05d3ab2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:01.030167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f38808-13d1-4cfd-92fc-c3d05d3ab2cf None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:01.031660 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c037d40-8c8a-41b6-91f9-666586336efb None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:01.032330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f38808-13d1-4cfd-92fc-c3d05d3ab2cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:01.032635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f38808-13d1-4cfd-92fc-c3d05d3ab2cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:01.034107 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f38808-13d1-4cfd-92fc-c3d05d3ab2cf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:01.050305 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 242/487] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:48:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:01.051144 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f38808-13d1-4cfd-92fc-c3d05d3ab2cf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:01.078849 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:01.092695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:01.155825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f38808-13d1-4cfd-92fc-c3d05d3ab2cf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:01.174467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c037d40-8c8a-41b6-91f9-666586336efb None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:01.194096 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173b54-505d-42a6-a1ab-474903092b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:01.195286 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173b54-505d-42a6-a1ab-474903092b1e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:01.195740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173b54-505d-42a6-a1ab-474903092b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:01.196208 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173b54-505d-42a6-a1ab-474903092b1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:01.207014 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173b54-505d-42a6-a1ab-474903092b1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-42173b54-505d-42a6-a1ab-474903092b1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:48:01.213036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:01.213927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:01.214714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:01.214714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:01.214714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:01.214714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:01.214714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:48:01.214714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:48:01.214714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:48:01.214714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:48:01.214714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:48:01.214714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:48:01.214714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:48:01.214714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:01.216195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c5792-541b-4f55-9ac8-57d2e8d24275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:01.216856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c5792-541b-4f55-9ac8-57d2e8d24275 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:01.217135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c5792-541b-4f55-9ac8-57d2e8d24275 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:01.217435 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c5792-541b-4f55-9ac8-57d2e8d24275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:01.217867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 243/488] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:48:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:01.222566 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c5792-541b-4f55-9ac8-57d2e8d24275 None admin] RBAC: Adding query filter params (role.id=bc1117423b4841a4ae3e7be8f54af3b7, scope.project.id=b82a0373e3b649f3a023efd8db204123, user.id=93815827ae97419abf6fa45fbab185f5) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:01.222566 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c5792-541b-4f55-9ac8-57d2e8d24275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:01.222566 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c5792-541b-4f55-9ac8-57d2e8d24275 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:01.223777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173b54-505d-42a6-a1ab-474903092b1e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:01.227457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 246/489] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:48:01 2022] GET /identity/v3/role_assignments?user.id=93815827ae97419abf6fa45fbab185f5&scope.project.id=b82a0373e3b649f3a023efd8db204123&role.id=bc1117423b4841a4ae3e7be8f54af3b7 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:01.229370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c5792-541b-4f55-9ac8-57d2e8d24275 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:01.394285 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:01.419879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173b54-505d-42a6-a1ab-474903092b1e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:01.433306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c5792-541b-4f55-9ac8-57d2e8d24275 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:01.434902 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:01.471143 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caf3d4-1eb5-48de-87fa-47f9e99296ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:01.471821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caf3d4-1eb5-48de-87fa-47f9e99296ba None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:01.472155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caf3d4-1eb5-48de-87fa-47f9e99296ba None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:01.472429 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caf3d4-1eb5-48de-87fa-47f9e99296ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:01.473149 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caf3d4-1eb5-48de-87fa-47f9e99296ba None admin] RBAC: Adding query filter params (role.id=bc1117423b4841a4ae3e7be8f54af3b7, scope.project.id=b82a0373e3b649f3a023efd8db204123, user.id=1277082583d64fc5a37d50f38393a51c) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:01.473505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caf3d4-1eb5-48de-87fa-47f9e99296ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:01.474926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caf3d4-1eb5-48de-87fa-47f9e99296ba None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:01.483013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 244/490] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:48:01 2022] GET /identity/v3/role_assignments?user.id=1277082583d64fc5a37d50f38393a51c&scope.project.id=b82a0373e3b649f3a023efd8db204123&role.id=bc1117423b4841a4ae3e7be8f54af3b7 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:01.483305 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c195945-eb16-44b3-9b9d-320448237525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:01.484187 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c195945-eb16-44b3-9b9d-320448237525 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:01.484657 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c195945-eb16-44b3-9b9d-320448237525 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:01.485133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c195945-eb16-44b3-9b9d-320448237525 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:01.486510 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c195945-eb16-44b3-9b9d-320448237525 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:01.487111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c195945-eb16-44b3-9b9d-320448237525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:01.488750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c195945-eb16-44b3-9b9d-320448237525 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:01.500474 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 247/491] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:48:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:01.505841 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caf3d4-1eb5-48de-87fa-47f9e99296ba None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:01.626875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caf3d4-1eb5-48de-87fa-47f9e99296ba None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:01.678971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2219c8-4bb3-4b50-b2fb-03fdf620994e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:01.679640 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2219c8-4bb3-4b50-b2fb-03fdf620994e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:01.679922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2219c8-4bb3-4b50-b2fb-03fdf620994e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:01.680196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2219c8-4bb3-4b50-b2fb-03fdf620994e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:01.706717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2219c8-4bb3-4b50-b2fb-03fdf620994e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:01.708107 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2219c8-4bb3-4b50-b2fb-03fdf620994e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:01.729328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-7e2219c8-4bb3-4b50-b2fb-03fdf620994e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:01.739903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:01.747315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:01.748208 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:01.748208 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:01.748208 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:01.748208 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 245/492] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:01.748443 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c195945-eb16-44b3-9b9d-320448237525 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:01.923842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e96fb-0550-4316-9c85-3d772432fe06 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:01.924123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e96fb-0550-4316-9c85-3d772432fe06 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:01.924399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e96fb-0550-4316-9c85-3d772432fe06 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:01.926015 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 246/493] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:01.933121 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24b362-533d-4258-b899-3c95f5a08412 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:01.933432 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24b362-533d-4258-b899-3c95f5a08412 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:01.933710 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24b362-533d-4258-b899-3c95f5a08412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:01.959262 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c195945-eb16-44b3-9b9d-320448237525 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:01.971578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ca24b362-533d-4258-b899-3c95f5a08412 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:01.972945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ca24b362-533d-4258-b899-3c95f5a08412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:02.051867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d73ca3-1204-4a4b-8825-07896acaceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:02.052487 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d73ca3-1204-4a4b-8825-07896acaceb1 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:02.052762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d73ca3-1204-4a4b-8825-07896acaceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:02.053034 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d73ca3-1204-4a4b-8825-07896acaceb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:02.053711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d73ca3-1204-4a4b-8825-07896acaceb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:02.054535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d73ca3-1204-4a4b-8825-07896acaceb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:02.058095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d73ca3-1204-4a4b-8825-07896acaceb1 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:02.083675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 248/494] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:02.098305 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d73ca3-1204-4a4b-8825-07896acaceb1 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:02.158070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 247/495] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:48:02.180340 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:02.318424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d73ca3-1204-4a4b-8825-07896acaceb1 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:02.363004 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9bacf-049d-4676-a0a1-a957c04e0f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:02.363898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9bacf-049d-4676-a0a1-a957c04e0f6f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:02.364396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9bacf-049d-4676-a0a1-a957c04e0f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:02.364803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9bacf-049d-4676-a0a1-a957c04e0f6f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:02.375925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9bacf-049d-4676-a0a1-a957c04e0f6f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:02.377601 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9bacf-049d-4676-a0a1-a957c04e0f6f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-efb9bacf-049d-4676-a0a1-a957c04e0f6f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:48:02.398269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:02.399382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:02.400493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:02.400493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:02.400493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:48:02.400493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:48:02.400493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:48:02.400493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:48:02.400493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:48:02.400493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:48:02.400493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 14:48:02.400493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:02.402373 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 249/496] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 31 14:48:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:02.408395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24b362-533d-4258-b899-3c95f5a08412 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:02.520084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24b362-533d-4258-b899-3c95f5a08412 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:02.557313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:02.563269 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3818b-b04a-4f9d-b931-14b2ab87e48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:02.564043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3818b-b04a-4f9d-b931-14b2ab87e48a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:02.564460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3818b-b04a-4f9d-b931-14b2ab87e48a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:02.566715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3818b-b04a-4f9d-b931-14b2ab87e48a None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:02.566715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3818b-b04a-4f9d-b931-14b2ab87e48a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:02.566715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3818b-b04a-4f9d-b931-14b2ab87e48a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:02.567635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3818b-b04a-4f9d-b931-14b2ab87e48a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:02.573922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9bacf-049d-4676-a0a1-a957c04e0f6f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:02.602984 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 248/497] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 31 14:48:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:02.611491 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3818b-b04a-4f9d-b931-14b2ab87e48a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:02.727196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:02.758595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9bacf-049d-4676-a0a1-a957c04e0f6f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:02.761848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3818b-b04a-4f9d-b931-14b2ab87e48a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:02.804876 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6353ea-a2b4-4ff6-aaa3-09ab5541641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:02.805922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6353ea-a2b4-4ff6-aaa3-09ab5541641b None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:02.806375 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6353ea-a2b4-4ff6-aaa3-09ab5541641b None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:02.806833 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6353ea-a2b4-4ff6-aaa3-09ab5541641b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:02.831347 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6353ea-a2b4-4ff6-aaa3-09ab5541641b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-1a6353ea-a2b4-4ff6-aaa3-09ab5541641b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:48:02.838410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:02.843179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:02.844008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:02.844008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:02.844008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:02.844008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:02.844008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:48:02.844008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:48:02.844008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:48:02.844008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:48:02.844008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:48:02.844008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:48:02.844008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:48:02.844008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:02.844623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6d0a6-24b7-4e5c-b5d2-24fc2fd8e7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:02.844623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6d0a6-24b7-4e5c-b5d2-24fc2fd8e7bf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:02.844623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6d0a6-24b7-4e5c-b5d2-24fc2fd8e7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:02.844623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6d0a6-24b7-4e5c-b5d2-24fc2fd8e7bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:02.851183 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 250/498] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:48:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:02.854287 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6353ea-a2b4-4ff6-aaa3-09ab5541641b None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:02.856323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6d0a6-24b7-4e5c-b5d2-24fc2fd8e7bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:02.857997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6d0a6-24b7-4e5c-b5d2-24fc2fd8e7bf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-31b6d0a6-24b7-4e5c-b5d2-24fc2fd8e7bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:02.876343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:02.877422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:02.878738 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:02.878738 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:02.878738 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:02.881333 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 249/499] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:02.887348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6d0a6-24b7-4e5c-b5d2-24fc2fd8e7bf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:02.937632 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:03.039425 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6d0a6-24b7-4e5c-b5d2-24fc2fd8e7bf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:03.079147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e318660-62f0-4214-861a-de92351c4614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:03.080016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e318660-62f0-4214-861a-de92351c4614 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:03.080308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e318660-62f0-4214-861a-de92351c4614 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:03.080591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e318660-62f0-4214-861a-de92351c4614 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:03.081237 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e318660-62f0-4214-861a-de92351c4614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:03.081622 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e318660-62f0-4214-861a-de92351c4614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:03.082933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e318660-62f0-4214-861a-de92351c4614 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:03.096546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 250/500] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:03.102488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e318660-62f0-4214-861a-de92351c4614 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:03.104683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6353ea-a2b4-4ff6-aaa3-09ab5541641b None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:03.174912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf740c5-eda8-44ca-8f4c-673810101a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:03.175528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf740c5-eda8-44ca-8f4c-673810101a46 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:03.175808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf740c5-eda8-44ca-8f4c-673810101a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:03.176073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf740c5-eda8-44ca-8f4c-673810101a46 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:03.176741 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf740c5-eda8-44ca-8f4c-673810101a46 None admin] RBAC: Adding query filter params (name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:03.177048 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf740c5-eda8-44ca-8f4c-673810101a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:03.178451 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf740c5-eda8-44ca-8f4c-673810101a46 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:03.193316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 251/501] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:48:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:03.193316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362632-100f-4a58-9469-836dd63ce456 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:03.193316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362632-100f-4a58-9469-836dd63ce456 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:03.193316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362632-100f-4a58-9469-836dd63ce456 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:03.197246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 252/502] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:03.198163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9362632-100f-4a58-9469-836dd63ce456 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:03.208037 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:03.247982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:03.250943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e318660-62f0-4214-861a-de92351c4614 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:03.287357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e0da5-fa34-4d11-8522-b7cf6acdaf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:03.288044 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e0da5-fa34-4d11-8522-b7cf6acdaf50 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:03.289062 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e0da5-fa34-4d11-8522-b7cf6acdaf50 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:03.289360 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e0da5-fa34-4d11-8522-b7cf6acdaf50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:03.297036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e0da5-fa34-4d11-8522-b7cf6acdaf50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:03.298530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e0da5-fa34-4d11-8522-b7cf6acdaf50 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-298e0da5-fa34-4d11-8522-b7cf6acdaf50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:03.310833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:03.311796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:03.312675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:03.312675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:03.312675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:03.312675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:03.312675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:03.312675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:03.312675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:03.312675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:03.312675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 251/503] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:03.313713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242f913-f275-4cd2-afd3-274ce0962cf8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:03.313993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242f913-f275-4cd2-afd3-274ce0962cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:03.314264 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242f913-f275-4cd2-afd3-274ce0962cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:03.333768 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5242f913-f275-4cd2-afd3-274ce0962cf8 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:03.335235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5242f913-f275-4cd2-afd3-274ce0962cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:03.340099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9362632-100f-4a58-9469-836dd63ce456 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:03.385816 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95891df2-8744-42d6-9e10-5419996bfb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:03.387023 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891df2-8744-42d6-9e10-5419996bfb80 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:03.387999 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891df2-8744-42d6-9e10-5419996bfb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:03.388565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891df2-8744-42d6-9e10-5419996bfb80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:03.403943 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95891df2-8744-42d6-9e10-5419996bfb80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:03.406567 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95891df2-8744-42d6-9e10-5419996bfb80 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:03.417433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 252/504] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:48:03.418443 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242f913-f275-4cd2-afd3-274ce0962cf8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-95891df2-8744-42d6-9e10-5419996bfb80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:03.423523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:03.424511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:03.425489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:03.425489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:03.425489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:03.428363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 253/505] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:03.436128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95891df2-8744-42d6-9e10-5419996bfb80 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:03.532598 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:03.582799 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95891df2-8744-42d6-9e10-5419996bfb80 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:03.621647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:03.624295 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaae16-e876-45df-acba-3b6edb132e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:03.625133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaae16-e876-45df-acba-3b6edb132e48 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:03.625930 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaae16-e876-45df-acba-3b6edb132e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:03.626394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaae16-e876-45df-acba-3b6edb132e48 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:03.627476 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaae16-e876-45df-acba-3b6edb132e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:03.627988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaae16-e876-45df-acba-3b6edb132e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:03.629722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaae16-e876-45df-acba-3b6edb132e48 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:03.642250 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242f913-f275-4cd2-afd3-274ce0962cf8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:03.644787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 254/506] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:03.651831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaae16-e876-45df-acba-3b6edb132e48 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:03.708088 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40782355-db13-4edf-a4d7-ff2b0a45d775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:03.708703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40782355-db13-4edf-a4d7-ff2b0a45d775 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:03.708977 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40782355-db13-4edf-a4d7-ff2b0a45d775 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:03.709246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40782355-db13-4edf-a4d7-ff2b0a45d775 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:03.709957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40782355-db13-4edf-a4d7-ff2b0a45d775 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:03.710865 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40782355-db13-4edf-a4d7-ff2b0a45d775 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:03.712289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40782355-db13-4edf-a4d7-ff2b0a45d775 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:03.734562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 253/507] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:03.740241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40782355-db13-4edf-a4d7-ff2b0a45d775 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:03.804511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaae16-e876-45df-acba-3b6edb132e48 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:03.826270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:03.848303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68917ea-d343-4faf-8786-43ce2ea900a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:03.849490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68917ea-d343-4faf-8786-43ce2ea900a6 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:03.850000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68917ea-d343-4faf-8786-43ce2ea900a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:03.850577 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68917ea-d343-4faf-8786-43ce2ea900a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:03.859797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68917ea-d343-4faf-8786-43ce2ea900a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:03.861568 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68917ea-d343-4faf-8786-43ce2ea900a6 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:03.869717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40782355-db13-4edf-a4d7-ff2b0a45d775 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-a68917ea-d343-4faf-8786-43ce2ea900a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:48:03.876901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:03.878145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:03.879205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:03.879205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:03.879205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:48:03.879205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:48:03.879205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:48:03.879205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:48:03.879205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:48:03.879205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:48:03.879205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 14:48:03.879205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:03.887624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 255/508] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:48:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:03.888812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68917ea-d343-4faf-8786-43ce2ea900a6 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:03.905241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a000628-ee4b-4a81-a370-d7678ed5bf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:03.905940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a000628-ee4b-4a81-a370-d7678ed5bf25 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:03.906189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a000628-ee4b-4a81-a370-d7678ed5bf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:03.906461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a000628-ee4b-4a81-a370-d7678ed5bf25 None admin] PATH_INFO: `/v3/projects/b82a0373e3b649f3a023efd8db204123/users/9ec30e419d6f4fddb05c4bb08f2ce3f0/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:03.908548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a000628-ee4b-4a81-a370-d7678ed5bf25 None admin] RBAC: Authorizing `identity:create_grant(project_id=b82a0373e3b649f3a023efd8db204123, user_id=9ec30e419d6f4fddb05c4bb08f2ce3f0, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:03.910067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a000628-ee4b-4a81-a370-d7678ed5bf25 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:03.996616 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68917ea-d343-4faf-8786-43ce2ea900a6 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:04.019109 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 254/509] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:48:03 2022] PUT /identity/v3/projects/b82a0373e3b649f3a023efd8db204123/users/9ec30e419d6f4fddb05c4bb08f2ce3f0/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:04.031379 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a000628-ee4b-4a81-a370-d7678ed5bf25 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:04.044092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29d59a-2776-4e23-a3d1-6008b74c28f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:04.044763 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29d59a-2776-4e23-a3d1-6008b74c28f5 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.045017 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29d59a-2776-4e23-a3d1-6008b74c28f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.045309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29d59a-2776-4e23-a3d1-6008b74c28f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:04.058856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29d59a-2776-4e23-a3d1-6008b74c28f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:04.060434 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29d59a-2776-4e23-a3d1-6008b74c28f5 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:04.063248 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-5c29d59a-2776-4e23-a3d1-6008b74c28f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:04.079878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:04.086304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:04.087303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:04.087303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:04.087303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:04.087303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 256/510] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:04.087303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394a400-1cb2-4702-9811-5e99bc4fbcba None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.087303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394a400-1cb2-4702-9811-5e99bc4fbcba None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.087303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394a400-1cb2-4702-9811-5e99bc4fbcba None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:04.087303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 257/511] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:04.090828 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a430c8-cba9-4716-97c4-e34ea08ed866 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.091111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a430c8-cba9-4716-97c4-e34ea08ed866 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.091385 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a430c8-cba9-4716-97c4-e34ea08ed866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:04.113411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-73a430c8-cba9-4716-97c4-e34ea08ed866 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:04.114922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-73a430c8-cba9-4716-97c4-e34ea08ed866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:04.146811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:04.199313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a000628-ee4b-4a81-a370-d7678ed5bf25 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:04.203080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 258/512] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:48:04.203727 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a430c8-cba9-4716-97c4-e34ea08ed866 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:04.244867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efbc36-c8c5-4d95-ba5a-91c0f5f24fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:04.246099 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efbc36-c8c5-4d95-ba5a-91c0f5f24fee None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.246099 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efbc36-c8c5-4d95-ba5a-91c0f5f24fee None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.246099 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efbc36-c8c5-4d95-ba5a-91c0f5f24fee None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:04.246737 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efbc36-c8c5-4d95-ba5a-91c0f5f24fee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:04.247039 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efbc36-c8c5-4d95-ba5a-91c0f5f24fee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:04.248448 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efbc36-c8c5-4d95-ba5a-91c0f5f24fee None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:04.270115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 255/513] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Oct 31 14:48:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:04.271789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1631342-26e5-410b-b947-891d85379f34 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.272467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1631342-26e5-410b-b947-891d85379f34 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.273506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1631342-26e5-410b-b947-891d85379f34 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:04.279826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 256/514] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:04.281339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1631342-26e5-410b-b947-891d85379f34 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:04.324918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a430c8-cba9-4716-97c4-e34ea08ed866 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:04.361226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:04.371632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91eec50-c461-48a5-a5d3-9a83a39b09f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:04.372243 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eec50-c461-48a5-a5d3-9a83a39b09f6 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.372523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eec50-c461-48a5-a5d3-9a83a39b09f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.372796 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eec50-c461-48a5-a5d3-9a83a39b09f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:04.374134 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91eec50-c461-48a5-a5d3-9a83a39b09f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:04.374440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91eec50-c461-48a5-a5d3-9a83a39b09f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:04.375850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91eec50-c461-48a5-a5d3-9a83a39b09f6 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:04.392670 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 259/515] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:04.397522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5377d7-d8c7-4c3e-b0de-637c73e0345a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.397522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5377d7-d8c7-4c3e-b0de-637c73e0345a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.397522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5377d7-d8c7-4c3e-b0de-637c73e0345a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:04.408253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1631342-26e5-410b-b947-891d85379f34 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:04.418862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-7e5377d7-d8c7-4c3e-b0de-637c73e0345a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:04.420327 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7e5377d7-d8c7-4c3e-b0de-637c73e0345a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:04.436596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:04.449398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad463cc-f32d-4db6-880e-2b9f9f03bf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:04.450396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad463cc-f32d-4db6-880e-2b9f9f03bf59 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.450734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad463cc-f32d-4db6-880e-2b9f9f03bf59 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.451071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad463cc-f32d-4db6-880e-2b9f9f03bf59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:04.501832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 260/516] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:48:04.502694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5377d7-d8c7-4c3e-b0de-637c73e0345a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:04.528131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad463cc-f32d-4db6-880e-2b9f9f03bf59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:04.529633 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad463cc-f32d-4db6-880e-2b9f9f03bf59 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:04.600209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:04.641802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 257/517] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:48:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 31 14:48:04.642669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad463cc-f32d-4db6-880e-2b9f9f03bf59 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:04.646909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5377d7-d8c7-4c3e-b0de-637c73e0345a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:04.683489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baee2b4-ff82-44dc-8488-25c2881ebfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:04.684156 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baee2b4-ff82-44dc-8488-25c2881ebfba None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.684657 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baee2b4-ff82-44dc-8488-25c2881ebfba None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.685026 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baee2b4-ff82-44dc-8488-25c2881ebfba None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:04.686601 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baee2b4-ff82-44dc-8488-25c2881ebfba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:04.688129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baee2b4-ff82-44dc-8488-25c2881ebfba None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:04.753156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad463cc-f32d-4db6-880e-2b9f9f03bf59 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:04.789312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 261/518] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:48:04 2022] POST /identity/v3/users => generated 254 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:04.789312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baee2b4-ff82-44dc-8488-25c2881ebfba None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:04.797682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43598a39-2f9e-4a30-ab5e-c072773b0861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:04.798332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43598a39-2f9e-4a30-ab5e-c072773b0861 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.798662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43598a39-2f9e-4a30-ab5e-c072773b0861 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.798940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43598a39-2f9e-4a30-ab5e-c072773b0861 None admin] PATH_INFO: `/v3/services/network` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:04.799238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:04.799525 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43598a39-2f9e-4a30-ab5e-c072773b0861 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:04.800929 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43598a39-2f9e-4a30-ab5e-c072773b0861 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-43598a39-2f9e-4a30-ab5e-c072773b0861 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:04.814736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:04.815786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 14:48:04.816674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:04.821505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 258/519] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:04 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:04.822514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43598a39-2f9e-4a30-ab5e-c072773b0861 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:04.861240 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:04.934597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baee2b4-ff82-44dc-8488-25c2881ebfba None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:04.941548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43598a39-2f9e-4a30-ab5e-c072773b0861 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:04.985554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99698cb-5997-4151-8554-8c82bf3f3fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:04.985554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99698cb-5997-4151-8554-8c82bf3f3fbe None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.987082 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99698cb-5997-4151-8554-8c82bf3f3fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.987082 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99698cb-5997-4151-8554-8c82bf3f3fbe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:04.987082 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99698cb-5997-4151-8554-8c82bf3f3fbe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:04.987318 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a7e5f-0bee-4557-901e-6378a015b8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:04.987831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a7e5f-0bee-4557-901e-6378a015b8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:04.988111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a7e5f-0bee-4557-901e-6378a015b8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:04.988263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99698cb-5997-4151-8554-8c82bf3f3fbe None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:04.988362 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a7e5f-0bee-4557-901e-6378a015b8c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c99698cb-5997-4151-8554-8c82bf3f3fbe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:05.000391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:05.001442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 14:48:05.002272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:05.004016 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a7e5f-0bee-4557-901e-6378a015b8c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:05.004160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 259/520] 10.222.0.45 () {56 vars in 1129 bytes} [Mon Oct 31 14:48:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:05.004160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99698cb-5997-4151-8554-8c82bf3f3fbe None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:05.006683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a7e5f-0bee-4557-901e-6378a015b8c0 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-a88a7e5f-0bee-4557-901e-6378a015b8c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:05.027492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:05.028485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:05.029830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:05.029830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:05.029830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:05.029830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 262/521] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:05.029830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a7e5f-0bee-4557-901e-6378a015b8c0 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:05.114860 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:05.120446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:05.126673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99698cb-5997-4151-8554-8c82bf3f3fbe None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:05.160312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a7e5f-0bee-4557-901e-6378a015b8c0 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:05.166523 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d974c0e-f9db-4f45-b0ba-d735e5444e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:05.167531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d974c0e-f9db-4f45-b0ba-d735e5444e7c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:05.168527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d974c0e-f9db-4f45-b0ba-d735e5444e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:05.169011 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d974c0e-f9db-4f45-b0ba-d735e5444e7c None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:05.169879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d974c0e-f9db-4f45-b0ba-d735e5444e7c None admin] RBAC: Adding query filter params (name=network) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:05.170867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d974c0e-f9db-4f45-b0ba-d735e5444e7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:05.173083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d974c0e-f9db-4f45-b0ba-d735e5444e7c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:05.180309 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 260/522] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 31 14:48:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:05.181461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d974c0e-f9db-4f45-b0ba-d735e5444e7c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:05.202651 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f671-c7d0-4815-9509-a81d78358fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:05.203169 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f671-c7d0-4815-9509-a81d78358fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:05.203510 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f671-c7d0-4815-9509-a81d78358fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:05.203877 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f671-c7d0-4815-9509-a81d78358fe4 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:05.204579 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f671-c7d0-4815-9509-a81d78358fe4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:05.205020 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f671-c7d0-4815-9509-a81d78358fe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:05.206492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940f671-c7d0-4815-9509-a81d78358fe4 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:05.212375 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 263/523] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Oct 31 14:48:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:05.213032 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f671-c7d0-4815-9509-a81d78358fe4 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:05.318632 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d974c0e-f9db-4f45-b0ba-d735e5444e7c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:05.330516 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f671-c7d0-4815-9509-a81d78358fe4 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:05.355940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c4f02-3116-4704-acd8-5a8cc0064291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:05.356755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c4f02-3116-4704-acd8-5a8cc0064291 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:05.357103 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c4f02-3116-4704-acd8-5a8cc0064291 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:05.359076 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c4f02-3116-4704-acd8-5a8cc0064291 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:05.359710 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c4f02-3116-4704-acd8-5a8cc0064291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:05.360085 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c4f02-3116-4704-acd8-5a8cc0064291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:05.361576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c4f02-3116-4704-acd8-5a8cc0064291 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:05.369640 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:05.380459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 261/524] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:05.380459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c4f02-3116-4704-acd8-5a8cc0064291 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:05.382541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e041086-5b2c-4bf0-8e6b-ae3fe03ec537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:05.383356 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e041086-5b2c-4bf0-8e6b-ae3fe03ec537 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:05.384197 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e041086-5b2c-4bf0-8e6b-ae3fe03ec537 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:05.398300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e041086-5b2c-4bf0-8e6b-ae3fe03ec537 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:05.398300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e041086-5b2c-4bf0-8e6b-ae3fe03ec537 None admin] RBAC: Adding query filter params (type=network) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:05.398300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e041086-5b2c-4bf0-8e6b-ae3fe03ec537 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:05.398300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e041086-5b2c-4bf0-8e6b-ae3fe03ec537 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:05.398300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 264/525] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 31 14:48:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:05.398300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e041086-5b2c-4bf0-8e6b-ae3fe03ec537 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:05.416938 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:05.560607 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c4f02-3116-4704-acd8-5a8cc0064291 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:05.604443 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae752ca6-cd61-406e-ade2-eef5ab0c1b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:05.605485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae752ca6-cd61-406e-ade2-eef5ab0c1b54 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:05.605813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae752ca6-cd61-406e-ade2-eef5ab0c1b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:05.606161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae752ca6-cd61-406e-ade2-eef5ab0c1b54 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:05.607061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae752ca6-cd61-406e-ade2-eef5ab0c1b54 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:05.607061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae752ca6-cd61-406e-ade2-eef5ab0c1b54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:05.608477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae752ca6-cd61-406e-ade2-eef5ab0c1b54 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:05.613935 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e041086-5b2c-4bf0-8e6b-ae3fe03ec537 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:05.615509 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 262/526] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Oct 31 14:48:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:05.658535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9c412-3a26-4612-a78d-fefdfa393e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:05.659235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9c412-3a26-4612-a78d-fefdfa393e83 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:05.659457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9c412-3a26-4612-a78d-fefdfa393e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:05.659729 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9c412-3a26-4612-a78d-fefdfa393e83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:05.668700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9c412-3a26-4612-a78d-fefdfa393e83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:05.670259 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9c412-3a26-4612-a78d-fefdfa393e83 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-74b9c412-3a26-4612-a78d-fefdfa393e83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:05.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:05.685898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:05.686844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:05.686844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:05.686844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:05.686844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:05.686844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:05.686844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:05.686844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:05.686844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:05.686844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 265/527] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:05.694617 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae752ca6-cd61-406e-ade2-eef5ab0c1b54 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:05.836729 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:05.852718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae752ca6-cd61-406e-ade2-eef5ab0c1b54 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:05.887252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b67145-a3d3-46fd-aa35-dbc41119655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:05.887858 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b67145-a3d3-46fd-aa35-dbc41119655e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:05.888134 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b67145-a3d3-46fd-aa35-dbc41119655e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:05.888399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b67145-a3d3-46fd-aa35-dbc41119655e None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:05.889083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b67145-a3d3-46fd-aa35-dbc41119655e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:05.889408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b67145-a3d3-46fd-aa35-dbc41119655e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:05.890868 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b67145-a3d3-46fd-aa35-dbc41119655e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:05.905242 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 263/528] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:48:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:05.911164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9c412-3a26-4612-a78d-fefdfa393e83 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:05.962616 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:06.024215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9c412-3a26-4612-a78d-fefdfa393e83 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:06.065828 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0a23a-05b6-480b-94d4-74ce0a9085ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:06.066443 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0a23a-05b6-480b-94d4-74ce0a9085ad None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:06.066717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0a23a-05b6-480b-94d4-74ce0a9085ad None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:06.066985 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0a23a-05b6-480b-94d4-74ce0a9085ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:06.067706 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0a23a-05b6-480b-94d4-74ce0a9085ad None admin] RBAC: Adding query filter params (role.id=bc1117423b4841a4ae3e7be8f54af3b7, scope.project.id=b82a0373e3b649f3a023efd8db204123, user.id=93cb8e24b84d4c26bf5fd58d93ebb6c4) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:06.068009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0a23a-05b6-480b-94d4-74ce0a9085ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:06.070042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0a23a-05b6-480b-94d4-74ce0a9085ad None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:06.079982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 266/529] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:48:05 2022] GET /identity/v3/role_assignments?user.id=93cb8e24b84d4c26bf5fd58d93ebb6c4&scope.project.id=b82a0373e3b649f3a023efd8db204123&role.id=bc1117423b4841a4ae3e7be8f54af3b7 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:06.576990 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666ab2b-adfd-43e4-a67c-ad1368a02fc7 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:06.577562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666ab2b-adfd-43e4-a67c-ad1368a02fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:06.577562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666ab2b-adfd-43e4-a67c-ad1368a02fc7 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:06.579164 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 264/530] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:06.584636 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542575f9-ec68-41af-a77e-c6cd8424cde8 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:06.585449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542575f9-ec68-41af-a77e-c6cd8424cde8 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:06.585733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542575f9-ec68-41af-a77e-c6cd8424cde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:06.609394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-542575f9-ec68-41af-a77e-c6cd8424cde8 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:06.610598 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-542575f9-ec68-41af-a77e-c6cd8424cde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:06.711075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 267/531] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:48:07.077066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666ab2b-adfd-43e4-a67c-ad1368a02fc7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:07.161759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e1c44-d85d-431b-95e9-a8e0e2b79ebb None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:07.162118 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e1c44-d85d-431b-95e9-a8e0e2b79ebb None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:07.162365 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e1c44-d85d-431b-95e9-a8e0e2b79ebb None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:07.164068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 268/532] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:48:07.169385 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369651f-6f1f-4242-b83e-d51e3c43429a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:07.169669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369651f-6f1f-4242-b83e-d51e3c43429a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:07.169945 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369651f-6f1f-4242-b83e-d51e3c43429a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:07.188955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e369651f-6f1f-4242-b83e-d51e3c43429a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:07.190186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e369651f-6f1f-4242-b83e-d51e3c43429a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:07.222011 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666ab2b-adfd-43e4-a67c-ad1368a02fc7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:07.236511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:07.261575 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645c919-5ce9-4af6-82fe-c739b075db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:07.262567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645c919-5ce9-4af6-82fe-c739b075db95 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:07.263059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645c919-5ce9-4af6-82fe-c739b075db95 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:07.263531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645c919-5ce9-4af6-82fe-c739b075db95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:07.275269 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645c919-5ce9-4af6-82fe-c739b075db95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2645c919-5ce9-4af6-82fe-c739b075db95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:48:07.281506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:07.282422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:07.283235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:07.283235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:07.283235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:07.283235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:07.283235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:48:07.283235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:48:07.283235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:48:07.283235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:48:07.283235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:48:07.283235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:48:07.283235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:48:07.283235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:07.285825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 265/533] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:48:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:07.291588 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645c919-5ce9-4af6-82fe-c739b075db95 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:07.300434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:07.313195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 269/534] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 31 14:48:07.417239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645c919-5ce9-4af6-82fe-c739b075db95 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:07.463545 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc289ca8-aa9f-46b9-b0e6-4c365990e434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:07.464574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc289ca8-aa9f-46b9-b0e6-4c365990e434 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:07.465056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc289ca8-aa9f-46b9-b0e6-4c365990e434 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:07.465555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc289ca8-aa9f-46b9-b0e6-4c365990e434 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:07.466403 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc289ca8-aa9f-46b9-b0e6-4c365990e434 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:07.466905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc289ca8-aa9f-46b9-b0e6-4c365990e434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:07.468527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc289ca8-aa9f-46b9-b0e6-4c365990e434 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:07.483005 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 266/535] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:48:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:07.488501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369651f-6f1f-4242-b83e-d51e3c43429a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:07.606659 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc289ca8-aa9f-46b9-b0e6-4c365990e434 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:07.628127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369651f-6f1f-4242-b83e-d51e3c43429a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:07.710543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5f4e4-e804-4439-bdc3-93f74b4eb307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:07.711191 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5f4e4-e804-4439-bdc3-93f74b4eb307 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:07.711723 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5f4e4-e804-4439-bdc3-93f74b4eb307 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:07.711723 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5f4e4-e804-4439-bdc3-93f74b4eb307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:07.721674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:07.740818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5f4e4-e804-4439-bdc3-93f74b4eb307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:07.743374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5f4e4-e804-4439-bdc3-93f74b4eb307 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-dcc5f4e4-e804-4439-bdc3-93f74b4eb307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:07.771293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:07.772314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:07.773211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:07.773211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:07.773211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:07.774044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 270/536] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:07.778232 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5f4e4-e804-4439-bdc3-93f74b4eb307 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:07.787265 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc289ca8-aa9f-46b9-b0e6-4c365990e434 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:07.827725 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:07.843432 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0beb1-a13c-4955-8ed2-53eefae16695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:07.844183 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0beb1-a13c-4955-8ed2-53eefae16695 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:07.844470 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0beb1-a13c-4955-8ed2-53eefae16695 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:07.844745 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0beb1-a13c-4955-8ed2-53eefae16695 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:07.857720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0beb1-a13c-4955-8ed2-53eefae16695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-98f0beb1-a13c-4955-8ed2-53eefae16695 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:48:07.864851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:07.865826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:07.867270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:07.867270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:07.867270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:07.867270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:07.867270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:48:07.867270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:48:07.867270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:48:07.867270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:48:07.867270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:48:07.867270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:48:07.867270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:48:07.867270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:07.867270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 267/537] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:48:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:07.873098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0beb1-a13c-4955-8ed2-53eefae16695 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:07.971771 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5f4e4-e804-4439-bdc3-93f74b4eb307 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.030349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb450e7c-adf4-4e52-bf87-7321c79f6c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:08.030894 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb450e7c-adf4-4e52-bf87-7321c79f6c8f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.031177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb450e7c-adf4-4e52-bf87-7321c79f6c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.031453 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb450e7c-adf4-4e52-bf87-7321c79f6c8f None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.032111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb450e7c-adf4-4e52-bf87-7321c79f6c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:08.032414 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb450e7c-adf4-4e52-bf87-7321c79f6c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:08.035814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb450e7c-adf4-4e52-bf87-7321c79f6c8f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.052009 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0beb1-a13c-4955-8ed2-53eefae16695 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.069229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 271/538] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:08.074893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb450e7c-adf4-4e52-bf87-7321c79f6c8f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.097704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:08.118003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2f42e-be38-4f22-bc48-b52216123fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:08.118715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2f42e-be38-4f22-bc48-b52216123fcb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.119059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2f42e-be38-4f22-bc48-b52216123fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.119399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2f42e-be38-4f22-bc48-b52216123fcb None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.120153 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2f42e-be38-4f22-bc48-b52216123fcb None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:08.120520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2f42e-be38-4f22-bc48-b52216123fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:08.122036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2f42e-be38-4f22-bc48-b52216123fcb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.142985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 268/539] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:48:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:08.158315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2f42e-be38-4f22-bc48-b52216123fcb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.182965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:08.221729 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb450e7c-adf4-4e52-bf87-7321c79f6c8f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.291494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7d41b-7557-407a-abb1-57a6835eabd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:08.293748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7d41b-7557-407a-abb1-57a6835eabd1 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.294312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7d41b-7557-407a-abb1-57a6835eabd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.294963 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7d41b-7557-407a-abb1-57a6835eabd1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.308069 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7d41b-7557-407a-abb1-57a6835eabd1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:08.310838 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7d41b-7557-407a-abb1-57a6835eabd1 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-36e7d41b-7557-407a-abb1-57a6835eabd1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:48:08.334423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:08.336045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:08.337005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:08.337005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:08.337005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:48:08.337005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:48:08.337005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:48:08.337005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:48:08.337005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:48:08.337005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:48:08.337005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 14:48:08.337005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:08.339074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 272/540] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 31 14:48:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:08.340392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c516d-de7e-41ad-a225-0573c04dee9f None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.340845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c516d-de7e-41ad-a225-0573c04dee9f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.341267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c516d-de7e-41ad-a225-0573c04dee9f None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.342995 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 273/541] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:08.344326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c516d-de7e-41ad-a225-0573c04dee9f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.359731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2f42e-be38-4f22-bc48-b52216123fcb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.400975 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799f952-0fdb-4157-8883-501383edf403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:08.402070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799f952-0fdb-4157-8883-501383edf403 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.402521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799f952-0fdb-4157-8883-501383edf403 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.402895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799f952-0fdb-4157-8883-501383edf403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.417163 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799f952-0fdb-4157-8883-501383edf403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:08.418722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799f952-0fdb-4157-8883-501383edf403 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c799f952-0fdb-4157-8883-501383edf403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:08.434261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:08.435261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:08.436123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:08.436123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:08.436123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:08.436123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 269/542] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:08.436939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8504b8-4f98-4e3e-b39d-6aea656c1d0e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.437225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8504b8-4f98-4e3e-b39d-6aea656c1d0e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.437523 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8504b8-4f98-4e3e-b39d-6aea656c1d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.456945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dc8504b8-4f98-4e3e-b39d-6aea656c1d0e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:08.458184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dc8504b8-4f98-4e3e-b39d-6aea656c1d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:08.468448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c516d-de7e-41ad-a225-0573c04dee9f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.495540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:08.504927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d060f3-0c30-441e-89a3-0b94d356d45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:08.511814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d060f3-0c30-441e-89a3-0b94d356d45c None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.511814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d060f3-0c30-441e-89a3-0b94d356d45c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.511814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d060f3-0c30-441e-89a3-0b94d356d45c None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.511814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d060f3-0c30-441e-89a3-0b94d356d45c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:08.511814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d060f3-0c30-441e-89a3-0b94d356d45c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:08.511814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d060f3-0c30-441e-89a3-0b94d356d45c None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.525653 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:08.534596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 270/543] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:48:08.534596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8218b47-c14a-45e5-8317-f788da4db463 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.534596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8218b47-c14a-45e5-8317-f788da4db463 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.534596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8218b47-c14a-45e5-8317-f788da4db463 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.534596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 271/544] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:08.534596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8218b47-c14a-45e5-8317-f788da4db463 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.535160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 274/545] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 31 14:48:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:08.536478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d060f3-0c30-441e-89a3-0b94d356d45c None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.651160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d060f3-0c30-441e-89a3-0b94d356d45c None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.671705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8218b47-c14a-45e5-8317-f788da4db463 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:08.698162 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9c95f-0cb1-46a3-8423-6733c60dc3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:08.699046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9c95f-0cb1-46a3-8423-6733c60dc3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.699326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9c95f-0cb1-46a3-8423-6733c60dc3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.699595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9c95f-0cb1-46a3-8423-6733c60dc3f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.714779 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a3bdb-8928-4cb7-b86e-c82698ea7f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:08.715391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a3bdb-8928-4cb7-b86e-c82698ea7f7c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.715697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a3bdb-8928-4cb7-b86e-c82698ea7f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.716393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a3bdb-8928-4cb7-b86e-c82698ea7f7c None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.717040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a3bdb-8928-4cb7-b86e-c82698ea7f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:08.717798 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a3bdb-8928-4cb7-b86e-c82698ea7f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:08.719428 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a3bdb-8928-4cb7-b86e-c82698ea7f7c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.735520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 272/546] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:08.736751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984b8ed-dd85-4805-a530-a6f9d440c940 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:08.737035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984b8ed-dd85-4805-a530-a6f9d440c940 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:08.737339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984b8ed-dd85-4805-a530-a6f9d440c940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:08.760547 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e984b8ed-dd85-4805-a530-a6f9d440c940 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:08.762293 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e984b8ed-dd85-4805-a530-a6f9d440c940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:08.785564 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:08.790127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9c95f-0cb1-46a3-8423-6733c60dc3f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:08.791831 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:08.793535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9c95f-0cb1-46a3-8423-6733c60dc3f3 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:08.839352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 273/547] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 31 14:48:08.840195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984b8ed-dd85-4805-a530-a6f9d440c940 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.941545 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 275/548] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:48:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 31 14:48:08.942495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9c95f-0cb1-46a3-8423-6733c60dc3f3 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:08.956625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984b8ed-dd85-4805-a530-a6f9d440c940 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.001363 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795cb4c-b68c-4089-8ea8-236055aa6edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.002147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795cb4c-b68c-4089-8ea8-236055aa6edd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.002496 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795cb4c-b68c-4089-8ea8-236055aa6edd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.002881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795cb4c-b68c-4089-8ea8-236055aa6edd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.011538 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795cb4c-b68c-4089-8ea8-236055aa6edd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.013094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795cb4c-b68c-4089-8ea8-236055aa6edd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d795cb4c-b68c-4089-8ea8-236055aa6edd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:48:09.027876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:09.028811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:09.029835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:09.029835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:09.029835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:48:09.029835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:48:09.029835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:48:09.029835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:48:09.029835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:48:09.029835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:48:09.029835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 14:48:09.029835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:09.034316 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 274/549] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 31 14:48:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:09.035257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795cb4c-b68c-4089-8ea8-236055aa6edd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.060146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:09.070158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:09.073755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9c95f-0cb1-46a3-8423-6733c60dc3f3 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.107813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09962b84-9edd-4f0c-acae-f15f1378d9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.109465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09962b84-9edd-4f0c-acae-f15f1378d9d2 None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.109465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09962b84-9edd-4f0c-acae-f15f1378d9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.109465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09962b84-9edd-4f0c-acae-f15f1378d9d2 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.109800 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09962b84-9edd-4f0c-acae-f15f1378d9d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.111289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09962b84-9edd-4f0c-acae-f15f1378d9d2 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.141131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795cb4c-b68c-4089-8ea8-236055aa6edd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.174978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfc013-9f43-47bb-bc8e-218ae13dae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.175597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfc013-9f43-47bb-bc8e-218ae13dae84 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.175878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfc013-9f43-47bb-bc8e-218ae13dae84 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.176158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfc013-9f43-47bb-bc8e-218ae13dae84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.186760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfc013-9f43-47bb-bc8e-218ae13dae84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.188193 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfc013-9f43-47bb-bc8e-218ae13dae84 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-03dfc013-9f43-47bb-bc8e-218ae13dae84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:09.205259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:09.206272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:09.207145 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:09.207145 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:09.207145 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:09.207145 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 275/550] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:09.207145 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfc013-9f43-47bb-bc8e-218ae13dae84 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.231815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 276/551] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:48:08 2022] POST /identity/v3/services => generated 240 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:09.233053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0f96-8ef4-4976-acbd-0136964af65d None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.233505 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0f96-8ef4-4976-acbd-0136964af65d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.233613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0f96-8ef4-4976-acbd-0136964af65d None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.237522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 277/552] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:09.237522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f0f96-8ef4-4976-acbd-0136964af65d None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.287562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:09.324283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfc013-9f43-47bb-bc8e-218ae13dae84 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.365146 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f0f96-8ef4-4976-acbd-0136964af65d None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.375849 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cc89e-30e9-44a5-a903-ad427245f9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.376467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cc89e-30e9-44a5-a903-ad427245f9bf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.376740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cc89e-30e9-44a5-a903-ad427245f9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.377015 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cc89e-30e9-44a5-a903-ad427245f9bf None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.377769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cc89e-30e9-44a5-a903-ad427245f9bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:09.378071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cc89e-30e9-44a5-a903-ad427245f9bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.379524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cc89e-30e9-44a5-a903-ad427245f9bf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.402001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 276/553] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Oct 31 14:48:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:09.403128 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cc89e-30e9-44a5-a903-ad427245f9bf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.413237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a640c-cad0-4e6e-9711-962f152d61bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.413884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a640c-cad0-4e6e-9711-962f152d61bc None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.414182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a640c-cad0-4e6e-9711-962f152d61bc None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.414434 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a640c-cad0-4e6e-9711-962f152d61bc None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.415091 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a640c-cad0-4e6e-9711-962f152d61bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.416651 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a640c-cad0-4e6e-9711-962f152d61bc None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.494748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 278/554] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:48:09 2022] POST /identity/v3/services => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:09.496009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f0d5-dc7d-4a61-b17a-c12f6d5243e5 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.496291 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f0d5-dc7d-4a61-b17a-c12f6d5243e5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.496563 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f0d5-dc7d-4a61-b17a-c12f6d5243e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.517788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cc89e-30e9-44a5-a903-ad427245f9bf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.519610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0ef8f0d5-dc7d-4a61-b17a-c12f6d5243e5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:09.522111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0ef8f0d5-dc7d-4a61-b17a-c12f6d5243e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:09.538655 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:09.557643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:09.577110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f2645-9e33-457d-8c0a-0fa67271c695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.577773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f2645-9e33-457d-8c0a-0fa67271c695 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.578130 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f2645-9e33-457d-8c0a-0fa67271c695 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.578476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f2645-9e33-457d-8c0a-0fa67271c695 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.579150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f2645-9e33-457d-8c0a-0fa67271c695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:09.579481 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f2645-9e33-457d-8c0a-0fa67271c695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.581936 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f2645-9e33-457d-8c0a-0fa67271c695 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.597038 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 277/555] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:09.598084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f2645-9e33-457d-8c0a-0fa67271c695 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.618625 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 279/556] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:09.620628 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8f0d5-dc7d-4a61-b17a-c12f6d5243e5 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.717191 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f2645-9e33-457d-8c0a-0fa67271c695 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.770479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8f0d5-dc7d-4a61-b17a-c12f6d5243e5 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.773191 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c50cf-9964-489f-862a-160863224c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.774813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c50cf-9964-489f-862a-160863224c23 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.775102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c50cf-9964-489f-862a-160863224c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.775382 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c50cf-9964-489f-862a-160863224c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.792040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c50cf-9964-489f-862a-160863224c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.793682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c50cf-9964-489f-862a-160863224c23 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.809984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1227f8-8002-4ba3-9736-8770b4b53c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:09.810609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1227f8-8002-4ba3-9736-8770b4b53c9c None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:09.810881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1227f8-8002-4ba3-9736-8770b4b53c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:09.811147 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1227f8-8002-4ba3-9736-8770b4b53c9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-372c50cf-9964-489f-862a-160863224c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:09.813621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:09.814513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:09.816049 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:09.816049 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:09.816049 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:09.816049 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 278/557] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:09.821255 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c50cf-9964-489f-862a-160863224c23 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.821496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1227f8-8002-4ba3-9736-8770b4b53c9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:09.822919 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1227f8-8002-4ba3-9736-8770b4b53c9c None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-3f1227f8-8002-4ba3-9736-8770b4b53c9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:09.836807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:09.843826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:09.844841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:09.844841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:09.844841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:09.844841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:09.844841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:09.844841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:09.844841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:09.844841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:09.844841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 280/558] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:09.844841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1227f8-8002-4ba3-9736-8770b4b53c9c None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:09.853592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:09.867736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:09.954642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1227f8-8002-4ba3-9736-8770b4b53c9c None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:09.955382 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c50cf-9964-489f-862a-160863224c23 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:10.004597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2685d34-4c2e-4476-bb97-7ff094de75de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.006059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2685d34-4c2e-4476-bb97-7ff094de75de None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.006542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2685d34-4c2e-4476-bb97-7ff094de75de None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.007773 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2685d34-4c2e-4476-bb97-7ff094de75de None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.008662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2685d34-4c2e-4476-bb97-7ff094de75de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:10.009157 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2685d34-4c2e-4476-bb97-7ff094de75de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:10.010829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2685d34-4c2e-4476-bb97-7ff094de75de None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:10.011479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0d9c9-6ddc-423c-b0c3-021a2bb89089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.012234 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0d9c9-6ddc-423c-b0c3-021a2bb89089 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.012516 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0d9c9-6ddc-423c-b0c3-021a2bb89089 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.012791 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0d9c9-6ddc-423c-b0c3-021a2bb89089 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.013525 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0d9c9-6ddc-423c-b0c3-021a2bb89089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:10.013837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0d9c9-6ddc-423c-b0c3-021a2bb89089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:10.015278 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0d9c9-6ddc-423c-b0c3-021a2bb89089 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:10.032922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 279/560] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:10.032922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0d9c9-6ddc-423c-b0c3-021a2bb89089 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:10.033354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 281/560] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:48:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:10.035643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2685d34-4c2e-4476-bb97-7ff094de75de None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:10.123703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:10.137544 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:10.145263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0d9c9-6ddc-423c-b0c3-021a2bb89089 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:10.169693 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2685d34-4c2e-4476-bb97-7ff094de75de None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:10.189375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc42450-3595-451f-83ad-c1233000efd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.190275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc42450-3595-451f-83ad-c1233000efd6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.190563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc42450-3595-451f-83ad-c1233000efd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.190833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc42450-3595-451f-83ad-c1233000efd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.207077 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc42450-3595-451f-83ad-c1233000efd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-cdc42450-3595-451f-83ad-c1233000efd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:48:10.213949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:10.215110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:10.215942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:10.215942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:10.215942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:10.215942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:10.215942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:48:10.215942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:48:10.215942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:48:10.215942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:48:10.215942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:48:10.215942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:48:10.215942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:48:10.215942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:10.217727 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f9183-6124-4528-a007-260393bf5c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.218912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f9183-6124-4528-a007-260393bf5c93 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.219357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f9183-6124-4528-a007-260393bf5c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.219786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f9183-6124-4528-a007-260393bf5c93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.220688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f9183-6124-4528-a007-260393bf5c93 None admin] RBAC: Adding query filter params (role.id=c62ffefc63e74a1280bef2b6a22202ad, scope.project.id=b82a0373e3b649f3a023efd8db204123, user.id=9ec30e419d6f4fddb05c4bb08f2ce3f0) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:10.221173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f9183-6124-4528-a007-260393bf5c93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:10.222812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f9183-6124-4528-a007-260393bf5c93 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:10.223401 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 280/561] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:10.224341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc42450-3595-451f-83ad-c1233000efd6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:10.231490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 282/562] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:48:10 2022] GET /identity/v3/role_assignments?user.id=9ec30e419d6f4fddb05c4bb08f2ce3f0&scope.project.id=b82a0373e3b649f3a023efd8db204123&role.id=c62ffefc63e74a1280bef2b6a22202ad => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:10.232551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f9183-6124-4528-a007-260393bf5c93 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:10.425803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f9183-6124-4528-a007-260393bf5c93 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:10.434592 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc42450-3595-451f-83ad-c1233000efd6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:10.477984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:10.479503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfc483-875a-441a-8ec3-67729a6d6f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.480341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfc483-875a-441a-8ec3-67729a6d6f9c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.480451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfc483-875a-441a-8ec3-67729a6d6f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.480667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfc483-875a-441a-8ec3-67729a6d6f9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.485562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b14203-335a-4e28-b41d-0a0aed5f8122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.486396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b14203-335a-4e28-b41d-0a0aed5f8122 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.486886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b14203-335a-4e28-b41d-0a0aed5f8122 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.487347 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b14203-335a-4e28-b41d-0a0aed5f8122 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.488218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b14203-335a-4e28-b41d-0a0aed5f8122 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:10.488477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfc483-875a-441a-8ec3-67729a6d6f9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:10.488919 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b14203-335a-4e28-b41d-0a0aed5f8122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:10.489960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfc483-875a-441a-8ec3-67729a6d6f9c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:10.490761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b14203-335a-4e28-b41d-0a0aed5f8122 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:10.500326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 283/563] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:48:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1cdfc483-875a-441a-8ec3-67729a6d6f9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:10.503932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:10.504765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:10.505978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:10.505978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:10.505978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:10.505978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:10.505978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:10.505978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:10.505978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:10.505978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:10.505978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 281/564] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:10.509932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b14203-335a-4e28-b41d-0a0aed5f8122 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:10.510412 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfc483-875a-441a-8ec3-67729a6d6f9c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:10.528398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:10.639334 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfc483-875a-441a-8ec3-67729a6d6f9c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:10.651584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b14203-335a-4e28-b41d-0a0aed5f8122 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:10.678386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95c9fc-66f8-45cf-8cf1-67640bfb4491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.679195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c9fc-66f8-45cf-8cf1-67640bfb4491 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.679723 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c9fc-66f8-45cf-8cf1-67640bfb4491 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.679999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95c9fc-66f8-45cf-8cf1-67640bfb4491 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.680720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95c9fc-66f8-45cf-8cf1-67640bfb4491 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:10.681035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95c9fc-66f8-45cf-8cf1-67640bfb4491 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:10.682496 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95c9fc-66f8-45cf-8cf1-67640bfb4491 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:10.696640 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 282/565] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:10.697195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84748c77-7ef8-4cb6-a984-d8d77e419610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.698085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84748c77-7ef8-4cb6-a984-d8d77e419610 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.698552 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84748c77-7ef8-4cb6-a984-d8d77e419610 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.699028 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84748c77-7ef8-4cb6-a984-d8d77e419610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.702296 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95c9fc-66f8-45cf-8cf1-67640bfb4491 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:10.713130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84748c77-7ef8-4cb6-a984-d8d77e419610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:10.715143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84748c77-7ef8-4cb6-a984-d8d77e419610 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-84748c77-7ef8-4cb6-a984-d8d77e419610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:10.733349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:10.734350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:10.735248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:10.735248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:10.735248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:10.737654 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 284/566] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:10.745699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84748c77-7ef8-4cb6-a984-d8d77e419610 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:10.827188 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:10.831386 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:10.883929 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95c9fc-66f8-45cf-8cf1-67640bfb4491 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:10.936402 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84748c77-7ef8-4cb6-a984-d8d77e419610 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:10.953609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c7ecb-8299-4f72-9986-7d1971f6e39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:10.954626 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7ecb-8299-4f72-9986-7d1971f6e39f None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:10.955119 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7ecb-8299-4f72-9986-7d1971f6e39f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:10.955591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7ecb-8299-4f72-9986-7d1971f6e39f None admin] PATH_INFO: `/v3/projects/b82a0373e3b649f3a023efd8db204123/users/439bd5d7fd094326aa92bcc5057fcc89/roles/bc1117423b4841a4ae3e7be8f54af3b7` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:10.989327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c7ecb-8299-4f72-9986-7d1971f6e39f None admin] RBAC: Authorizing `identity:create_grant(project_id=b82a0373e3b649f3a023efd8db204123, user_id=439bd5d7fd094326aa92bcc5057fcc89, role_id=bc1117423b4841a4ae3e7be8f54af3b7)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:10.989327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c7ecb-8299-4f72-9986-7d1971f6e39f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:11.002772 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc91fbe-a097-4a9f-9cfd-925f8dd6b3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:11.003473 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc91fbe-a097-4a9f-9cfd-925f8dd6b3ae None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:11.003749 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc91fbe-a097-4a9f-9cfd-925f8dd6b3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:11.004066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc91fbe-a097-4a9f-9cfd-925f8dd6b3ae None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:11.004704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc91fbe-a097-4a9f-9cfd-925f8dd6b3ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:11.005090 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc91fbe-a097-4a9f-9cfd-925f8dd6b3ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:11.006599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc91fbe-a097-4a9f-9cfd-925f8dd6b3ae None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:11.019988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 285/567] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:11.026076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc91fbe-a097-4a9f-9cfd-925f8dd6b3ae None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:11.076000 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 283/568] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:48:10 2022] PUT /identity/v3/projects/b82a0373e3b649f3a023efd8db204123/users/439bd5d7fd094326aa92bcc5057fcc89/roles/bc1117423b4841a4ae3e7be8f54af3b7 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:11.138403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc91fbe-a097-4a9f-9cfd-925f8dd6b3ae None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:11.140933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:11.177422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223096c-0088-4141-9b54-c1fc63066f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:11.178150 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223096c-0088-4141-9b54-c1fc63066f21 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:11.178427 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223096c-0088-4141-9b54-c1fc63066f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:11.179429 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223096c-0088-4141-9b54-c1fc63066f21 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:11.188203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223096c-0088-4141-9b54-c1fc63066f21 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:11.189612 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223096c-0088-4141-9b54-c1fc63066f21 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-9223096c-0088-4141-9b54-c1fc63066f21 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:48:11.203039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:11.204149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:11.205120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:11.205120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:11.205120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:48:11.205120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:48:11.205120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:48:11.205120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:48:11.205120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:48:11.205120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:48:11.205120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 14:48:11.205120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:11.205120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 286/569] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:48:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:11.210964 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c7ecb-8299-4f72-9986-7d1971f6e39f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:11.331256 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c7ecb-8299-4f72-9986-7d1971f6e39f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:11.355789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:11.367437 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcee1c-7844-4268-ba15-451a95242d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:11.368045 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcee1c-7844-4268-ba15-451a95242d11 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:11.368321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcee1c-7844-4268-ba15-451a95242d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:11.368586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcee1c-7844-4268-ba15-451a95242d11 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:11.369328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcee1c-7844-4268-ba15-451a95242d11 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:11.374127 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcee1c-7844-4268-ba15-451a95242d11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:11.374127 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcee1c-7844-4268-ba15-451a95242d11 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:11.391140 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 284/570] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Oct 31 14:48:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:11.396877 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223096c-0088-4141-9b54-c1fc63066f21 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:11.502613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223096c-0088-4141-9b54-c1fc63066f21 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:11.540768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594cd26-f466-47a4-94bf-f6c494468d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:11.541448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594cd26-f466-47a4-94bf-f6c494468d24 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:11.541726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594cd26-f466-47a4-94bf-f6c494468d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:11.541994 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594cd26-f466-47a4-94bf-f6c494468d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:11.553737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594cd26-f466-47a4-94bf-f6c494468d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:11.555203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594cd26-f466-47a4-94bf-f6c494468d24 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-4594cd26-f466-47a4-94bf-f6c494468d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:11.570456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:11.571495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:11.572371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:11.572371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:11.572371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:11.572371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 287/571] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:11.577414 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcee1c-7844-4268-ba15-451a95242d11 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:11.686142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcee1c-7844-4268-ba15-451a95242d11 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:11.721476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62221af-239d-410b-a2fa-a5840f707d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:11.722080 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62221af-239d-410b-a2fa-a5840f707d43 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:11.722353 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62221af-239d-410b-a2fa-a5840f707d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:11.722623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62221af-239d-410b-a2fa-a5840f707d43 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:11.723260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62221af-239d-410b-a2fa-a5840f707d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:11.723557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62221af-239d-410b-a2fa-a5840f707d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:11.724906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62221af-239d-410b-a2fa-a5840f707d43 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:11.737427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 285/572] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:11.743014 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594cd26-f466-47a4-94bf-f6c494468d24 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:11.749540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8a9c7-e60f-4d22-896b-4f5434ed2660 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:11.749828 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8a9c7-e60f-4d22-896b-4f5434ed2660 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:11.750106 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8a9c7-e60f-4d22-896b-4f5434ed2660 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:11.751676 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 286/573] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:11.757143 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a85b7-3079-4ca3-9bae-f727bee29fc9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:11.757489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a85b7-3079-4ca3-9bae-f727bee29fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:11.757768 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a85b7-3079-4ca3-9bae-f727bee29fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:11.769132 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:11.786352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c54a85b7-3079-4ca3-9bae-f727bee29fc9 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:11.792181 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c54a85b7-3079-4ca3-9bae-f727bee29fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:11.829155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:11.856817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 287/574] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:11.951825 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594cd26-f466-47a4-94bf-f6c494468d24 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.008744 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ec716-4b5a-4aab-a7f2-1653f42f0edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:12.009330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ec716-4b5a-4aab-a7f2-1653f42f0edd None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.009646 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ec716-4b5a-4aab-a7f2-1653f42f0edd None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.009950 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ec716-4b5a-4aab-a7f2-1653f42f0edd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.020856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ec716-4b5a-4aab-a7f2-1653f42f0edd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:12.022474 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ec716-4b5a-4aab-a7f2-1653f42f0edd None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-322ec716-4b5a-4aab-a7f2-1653f42f0edd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:12.039543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:12.040416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:12.041316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:12.041316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:12.041316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:12.041316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:12.041316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:12.041316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:12.041316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:12.041316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:12.041316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 288/575] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:12.046457 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a85b7-3079-4ca3-9bae-f727bee29fc9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:12.218924 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a85b7-3079-4ca3-9bae-f727bee29fc9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.228012 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0733-fcce-48d0-a9a2-0b7aea8769e2 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.228327 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0733-fcce-48d0-a9a2-0b7aea8769e2 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.228629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd0733-fcce-48d0-a9a2-0b7aea8769e2 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.230298 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 289/576] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:12.236856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497f62f-9c1c-4cfc-8ed1-8ec0487ddbc9 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.237166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497f62f-9c1c-4cfc-8ed1-8ec0487ddbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.237490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497f62f-9c1c-4cfc-8ed1-8ec0487ddbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.260686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f497f62f-9c1c-4cfc-8ed1-8ec0487ddbc9 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:12.261836 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f497f62f-9c1c-4cfc-8ed1-8ec0487ddbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:12.264802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23842ab-1f48-48dc-b3e7-07476b3da5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:12.265608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23842ab-1f48-48dc-b3e7-07476b3da5cc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.266043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23842ab-1f48-48dc-b3e7-07476b3da5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.266457 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23842ab-1f48-48dc-b3e7-07476b3da5cc None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.267297 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23842ab-1f48-48dc-b3e7-07476b3da5cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:12.267833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23842ab-1f48-48dc-b3e7-07476b3da5cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:12.269570 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23842ab-1f48-48dc-b3e7-07476b3da5cc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:12.283353 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 288/577] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:48:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:12.289521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23842ab-1f48-48dc-b3e7-07476b3da5cc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:12.353648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:12.360716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 290/578] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:12.361586 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497f62f-9c1c-4cfc-8ed1-8ec0487ddbc9 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:12.377570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:12.432603 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23842ab-1f48-48dc-b3e7-07476b3da5cc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.470289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aa065-7e79-46be-8154-18c81bf1210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:12.471187 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aa065-7e79-46be-8154-18c81bf1210a None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.471696 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aa065-7e79-46be-8154-18c81bf1210a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.472138 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aa065-7e79-46be-8154-18c81bf1210a None admin] PATH_INFO: `/v3/projects/b82a0373e3b649f3a023efd8db204123/users/93cb8e24b84d4c26bf5fd58d93ebb6c4/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.474233 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aa065-7e79-46be-8154-18c81bf1210a None admin] RBAC: Authorizing `identity:create_grant(project_id=b82a0373e3b649f3a023efd8db204123, user_id=93cb8e24b84d4c26bf5fd58d93ebb6c4, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:12.475909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1aa065-7e79-46be-8154-18c81bf1210a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:12.539557 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497f62f-9c1c-4cfc-8ed1-8ec0487ddbc9 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.571874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 289/579] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:48:12 2022] PUT /identity/v3/projects/b82a0373e3b649f3a023efd8db204123/users/93cb8e24b84d4c26bf5fd58d93ebb6c4/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:48:12.584071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8179d6-044c-4c4d-a840-9527fc948e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:12.585671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8179d6-044c-4c4d-a840-9527fc948e4e None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.586272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8179d6-044c-4c4d-a840-9527fc948e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.586710 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8179d6-044c-4c4d-a840-9527fc948e4e None admin] PATH_INFO: `/v3/services/network` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.587551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8179d6-044c-4c4d-a840-9527fc948e4e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:12.589189 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8179d6-044c-4c4d-a840-9527fc948e4e None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-6e8179d6-044c-4c4d-a840-9527fc948e4e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:12.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:12.603463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 14:48:12.604686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:12.607079 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 291/580] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:12 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:12.623516 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aa065-7e79-46be-8154-18c81bf1210a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:12.686635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8179d6-044c-4c4d-a840-9527fc948e4e None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:12.745942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aa065-7e79-46be-8154-18c81bf1210a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.749974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:12.765957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:12.795690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec4917-b9d7-4d9b-aece-ebe45da4876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:12.796777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec4917-b9d7-4d9b-aece-ebe45da4876a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.797538 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec4917-b9d7-4d9b-aece-ebe45da4876a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.798218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec4917-b9d7-4d9b-aece-ebe45da4876a None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.799002 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec4917-b9d7-4d9b-aece-ebe45da4876a None admin] RBAC: Adding query filter params (name=network) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:12.799465 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec4917-b9d7-4d9b-aece-ebe45da4876a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:12.799869 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8179d6-044c-4c4d-a840-9527fc948e4e None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.801913 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec4917-b9d7-4d9b-aece-ebe45da4876a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:12.807932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 290/581] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 31 14:48:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:12.814372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec4917-b9d7-4d9b-aece-ebe45da4876a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:12.846214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00039b56-7e46-492b-ade3-b4fd04c2ada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:12.847690 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00039b56-7e46-492b-ade3-b4fd04c2ada1 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:12.848282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00039b56-7e46-492b-ade3-b4fd04c2ada1 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:12.848833 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00039b56-7e46-492b-ade3-b4fd04c2ada1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:12.849615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00039b56-7e46-492b-ade3-b4fd04c2ada1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:12.852152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00039b56-7e46-492b-ade3-b4fd04c2ada1 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-00039b56-7e46-492b-ade3-b4fd04c2ada1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:12.863422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:12.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 14:48:12.865412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:12.868082 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 292/582] 10.222.0.45 () {56 vars in 1129 bytes} [Mon Oct 31 14:48:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:12.874149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00039b56-7e46-492b-ade3-b4fd04c2ada1 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:12.990627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00039b56-7e46-492b-ade3-b4fd04c2ada1 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:12.994149 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec4917-b9d7-4d9b-aece-ebe45da4876a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.028065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f4426-e1bc-4952-8936-4580edfbc7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.028616 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f4426-e1bc-4952-8936-4580edfbc7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.028865 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f4426-e1bc-4952-8936-4580edfbc7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.029136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f4426-e1bc-4952-8936-4580edfbc7f0 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.029888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f4426-e1bc-4952-8936-4580edfbc7f0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:13.030446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f4426-e1bc-4952-8936-4580edfbc7f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.031808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f4426-e1bc-4952-8936-4580edfbc7f0 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.033093 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:13.037769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 293/583] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Oct 31 14:48:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:13.047190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9539200-fe17-4503-9c78-65fd00490ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.048141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f4426-e1bc-4952-8936-4580edfbc7f0 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:13.048258 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9539200-fe17-4503-9c78-65fd00490ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.048833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9539200-fe17-4503-9c78-65fd00490ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.049405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9539200-fe17-4503-9c78-65fd00490ce8 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.050355 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9539200-fe17-4503-9c78-65fd00490ce8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:13.050901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9539200-fe17-4503-9c78-65fd00490ce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.052828 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9539200-fe17-4503-9c78-65fd00490ce8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.060026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 291/584] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 31 14:48:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:13.070757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9539200-fe17-4503-9c78-65fd00490ce8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:13.097656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:13.209027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f4426-e1bc-4952-8936-4580edfbc7f0 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.248393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e996a-dff6-4eda-85a0-cda5d3347541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.249067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e996a-dff6-4eda-85a0-cda5d3347541 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.249374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e996a-dff6-4eda-85a0-cda5d3347541 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.249648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e996a-dff6-4eda-85a0-cda5d3347541 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.250811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e996a-dff6-4eda-85a0-cda5d3347541 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:13.251119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e996a-dff6-4eda-85a0-cda5d3347541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.252709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e996a-dff6-4eda-85a0-cda5d3347541 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.258690 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 294/585] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Oct 31 14:48:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:13.264218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e996a-dff6-4eda-85a0-cda5d3347541 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:13.307504 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9539200-fe17-4503-9c78-65fd00490ce8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.347139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:13.355275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72540557-12d7-4155-94e1-0698765d33aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.361718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72540557-12d7-4155-94e1-0698765d33aa None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.361718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72540557-12d7-4155-94e1-0698765d33aa None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.361718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72540557-12d7-4155-94e1-0698765d33aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.361718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72540557-12d7-4155-94e1-0698765d33aa None admin] RBAC: Adding query filter params (interface=public, service_id=78fd8f11c91f4006a09023942023d235, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:13.361718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72540557-12d7-4155-94e1-0698765d33aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.361718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72540557-12d7-4155-94e1-0698765d33aa None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.373452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 292/586] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 31 14:48:13 2022] GET /identity/v3/endpoints?service_id=78fd8f11c91f4006a09023942023d235&interface=public®ion_id=RegionOne => generated 194 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:13.374602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b61d67-cb93-4dfe-9e8b-83c7070e8e2c None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.374838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b61d67-cb93-4dfe-9e8b-83c7070e8e2c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.375118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b61d67-cb93-4dfe-9e8b-83c7070e8e2c None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.376719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 293/587] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:13.378536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b61d67-cb93-4dfe-9e8b-83c7070e8e2c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:13.401659 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e996a-dff6-4eda-85a0-cda5d3347541 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.439363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ca5e2-8ea1-40a7-8ea1-9611e3636fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.440138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ca5e2-8ea1-40a7-8ea1-9611e3636fdb None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.440553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ca5e2-8ea1-40a7-8ea1-9611e3636fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.440979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ca5e2-8ea1-40a7-8ea1-9611e3636fdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.441822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ca5e2-8ea1-40a7-8ea1-9611e3636fdb None admin] RBAC: Adding query filter params (interface=public, service_id=a66a4ad9a4414ba2beaf13418429eb5e, region_id=RegionOne) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:13.442233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ca5e2-8ea1-40a7-8ea1-9611e3636fdb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.443914 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ca5e2-8ea1-40a7-8ea1-9611e3636fdb None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.452579 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 295/588] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 31 14:48:13 2022] GET /identity/v3/endpoints?service_id=a66a4ad9a4414ba2beaf13418429eb5e&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:13.454221 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e031482-24d9-436c-9a06-d0997b6b2889 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.454600 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e031482-24d9-436c-9a06-d0997b6b2889 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.454969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e031482-24d9-436c-9a06-d0997b6b2889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.475034 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-6e031482-24d9-436c-9a06-d0997b6b2889 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:13.476681 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6e031482-24d9-436c-9a06-d0997b6b2889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:13.482897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:13.501127 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b61d67-cb93-4dfe-9e8b-83c7070e8e2c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.543572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cef1a-d959-49fd-8f40-1d4af3f8c6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.544421 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cef1a-d959-49fd-8f40-1d4af3f8c6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.545162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cef1a-d959-49fd-8f40-1d4af3f8c6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.545603 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cef1a-d959-49fd-8f40-1d4af3f8c6e5 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.547043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cef1a-d959-49fd-8f40-1d4af3f8c6e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.548762 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cef1a-d959-49fd-8f40-1d4af3f8c6e5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.554789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 294/590] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 31 14:48:13 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:13.554946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 296/590] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:13.555985 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e031482-24d9-436c-9a06-d0997b6b2889 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:13.663725 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:13.705644 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef0f6a-6787-4002-80a5-adb5d589e4b5 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.705942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef0f6a-6787-4002-80a5-adb5d589e4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.706184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef0f6a-6787-4002-80a5-adb5d589e4b5 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.707886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 295/591] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:48:13.713795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dec49a-5363-4694-967a-d9ea63f6f442 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.714074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dec49a-5363-4694-967a-d9ea63f6f442 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.714353 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dec49a-5363-4694-967a-d9ea63f6f442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.743174 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e031482-24d9-436c-9a06-d0997b6b2889 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:13.750353 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-77dec49a-5363-4694-967a-d9ea63f6f442 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:13.751536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-77dec49a-5363-4694-967a-d9ea63f6f442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:13.791884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b41eb-9037-420e-8567-2607f319f95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:13.792730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b41eb-9037-420e-8567-2607f319f95c None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:13.792944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b41eb-9037-420e-8567-2607f319f95c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:13.793215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b41eb-9037-420e-8567-2607f319f95c None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:13.793851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b41eb-9037-420e-8567-2607f319f95c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:13.795206 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b41eb-9037-420e-8567-2607f319f95c None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:13.800727 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 297/592] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 31 14:48:13 2022] GET /identity/v3/services => generated 772 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:13.841938 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 296/593] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:13.889634 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b41eb-9037-420e-8567-2607f319f95c None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:14.041255 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b41eb-9037-420e-8567-2607f319f95c None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:14.062087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:14.076265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4267c4c-a9c5-4591-a08d-9101cccec016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:14.076892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4267c4c-a9c5-4591-a08d-9101cccec016 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:14.077163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4267c4c-a9c5-4591-a08d-9101cccec016 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:14.077460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4267c4c-a9c5-4591-a08d-9101cccec016 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:14.078037 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4267c4c-a9c5-4591-a08d-9101cccec016 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:14.079393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4267c4c-a9c5-4591-a08d-9101cccec016 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-f4267c4c-a9c5-4591-a08d-9101cccec016 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:14.089421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:14.090416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:14.091369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 298/594] 10.222.0.45 () {56 vars in 1132 bytes} [Mon Oct 31 14:48:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:14.096282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dec49a-5363-4694-967a-d9ea63f6f442 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:14.188367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:14.215012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dec49a-5363-4694-967a-d9ea63f6f442 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:14.265134 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4267c4c-a9c5-4591-a08d-9101cccec016 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:14.266750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065b066-2f47-4962-8523-97faf2dd4443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:14.267371 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065b066-2f47-4962-8523-97faf2dd4443 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:14.267650 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065b066-2f47-4962-8523-97faf2dd4443 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:14.267906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065b066-2f47-4962-8523-97faf2dd4443 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:14.268539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065b066-2f47-4962-8523-97faf2dd4443 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:14.268836 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065b066-2f47-4962-8523-97faf2dd4443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:14.270241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065b066-2f47-4962-8523-97faf2dd4443 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:14.275464 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 297/595] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 31 14:48:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:14.281558 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065b066-2f47-4962-8523-97faf2dd4443 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:14.393049 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065b066-2f47-4962-8523-97faf2dd4443 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:14.430635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdc70f-d489-48c5-b5c7-870fee2aee57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:14.431244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc70f-d489-48c5-b5c7-870fee2aee57 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:14.431521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc70f-d489-48c5-b5c7-870fee2aee57 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:14.431792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc70f-d489-48c5-b5c7-870fee2aee57 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:14.432422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdc70f-d489-48c5-b5c7-870fee2aee57 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:14.432718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdc70f-d489-48c5-b5c7-870fee2aee57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:14.434114 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdc70f-d489-48c5-b5c7-870fee2aee57 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:14.447683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 298/596] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 31 14:48:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:14.469090 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4267c4c-a9c5-4591-a08d-9101cccec016 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:14.507787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466004d-fe9b-452d-9bff-f4696667ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:14.508439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466004d-fe9b-452d-9bff-f4696667ede4 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:14.508714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466004d-fe9b-452d-9bff-f4696667ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:14.508981 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466004d-fe9b-452d-9bff-f4696667ede4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:14.521126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5466004d-fe9b-452d-9bff-f4696667ede4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-5466004d-fe9b-452d-9bff-f4696667ede4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:48:14.527045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:14.528033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:14.528863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:14.528863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:14.528863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:14.528863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:14.528863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:48:14.528863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:48:14.528863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:48:14.528863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:48:14.528863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:48:14.528863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:48:14.528863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:48:14.528863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:14.528863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 299/597] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:48:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:14.536367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdc70f-d489-48c5-b5c7-870fee2aee57 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:14.556477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:14.693696 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdc70f-d489-48c5-b5c7-870fee2aee57 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:14.736173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c18af1-7034-478f-b353-2cea245f75e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:14.736785 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18af1-7034-478f-b353-2cea245f75e1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:14.737058 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18af1-7034-478f-b353-2cea245f75e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:14.737349 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18af1-7034-478f-b353-2cea245f75e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:14.738045 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c18af1-7034-478f-b353-2cea245f75e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:14.738303 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c18af1-7034-478f-b353-2cea245f75e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:14.739655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c18af1-7034-478f-b353-2cea245f75e1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:14.751480 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 299/598] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:48:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:14.758006 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466004d-fe9b-452d-9bff-f4696667ede4 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:14.820549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:14.882379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466004d-fe9b-452d-9bff-f4696667ede4 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:14.919306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304f58a-7b03-401d-862d-3802b411219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:14.920309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304f58a-7b03-401d-862d-3802b411219c None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:14.920815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304f58a-7b03-401d-862d-3802b411219c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:14.921317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304f58a-7b03-401d-862d-3802b411219c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:14.933385 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304f58a-7b03-401d-862d-3802b411219c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:14.935160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304f58a-7b03-401d-862d-3802b411219c None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-2304f58a-7b03-401d-862d-3802b411219c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:14.950559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:14.951650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:14.952522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:14.952522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:14.952522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:14.954625 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 300/599] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:14.960999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c18af1-7034-478f-b353-2cea245f75e1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:15.032595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:15.071307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c18af1-7034-478f-b353-2cea245f75e1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:15.108001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d8013-b595-481d-9ccd-90c95012779c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:15.108658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8013-b595-481d-9ccd-90c95012779c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:15.108898 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8013-b595-481d-9ccd-90c95012779c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:15.109175 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8013-b595-481d-9ccd-90c95012779c None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:15.109848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d8013-b595-481d-9ccd-90c95012779c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:15.110210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d8013-b595-481d-9ccd-90c95012779c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:15.111587 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d8013-b595-481d-9ccd-90c95012779c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:15.124267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 300/600] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:15.130031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304f58a-7b03-401d-862d-3802b411219c None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:15.237654 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304f58a-7b03-401d-862d-3802b411219c None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:15.240036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:15.273053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a760ba-deb6-44c1-aead-4dcaf25f9efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:15.273737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a760ba-deb6-44c1-aead-4dcaf25f9efe None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:15.274015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a760ba-deb6-44c1-aead-4dcaf25f9efe None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:15.274284 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a760ba-deb6-44c1-aead-4dcaf25f9efe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:15.282408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a760ba-deb6-44c1-aead-4dcaf25f9efe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:15.283852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a760ba-deb6-44c1-aead-4dcaf25f9efe None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-04a760ba-deb6-44c1-aead-4dcaf25f9efe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:48:15.296336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:15.297279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:15.298239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:15.298239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:15.298239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:48:15.298239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:48:15.298239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:48:15.298239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:48:15.298239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:48:15.298239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:48:15.298239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 14:48:15.298239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:15.298239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 301/601] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 31 14:48:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:15.305238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d8013-b595-481d-9ccd-90c95012779c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:15.434494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d8013-b595-481d-9ccd-90c95012779c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:15.469931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:15.484236 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921ffa2-a1eb-4674-8452-ba6b443baa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:15.484914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ffa2-a1eb-4674-8452-ba6b443baa85 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:15.488427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ffa2-a1eb-4674-8452-ba6b443baa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:15.488427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ffa2-a1eb-4674-8452-ba6b443baa85 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:15.488427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921ffa2-a1eb-4674-8452-ba6b443baa85 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:15.488427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921ffa2-a1eb-4674-8452-ba6b443baa85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:15.488427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921ffa2-a1eb-4674-8452-ba6b443baa85 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:15.511267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 301/602] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Oct 31 14:48:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:15.517056 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a760ba-deb6-44c1-aead-4dcaf25f9efe None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:15.559755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e799-c14b-427f-8f0b-36d1abbc5010 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:15.560079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e799-c14b-427f-8f0b-36d1abbc5010 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:15.560292 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e799-c14b-427f-8f0b-36d1abbc5010 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:15.561654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 302/603] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:15.570901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a62f8-a758-49ee-a9f3-e814b2253590 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:15.571179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a62f8-a758-49ee-a9f3-e814b2253590 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:15.571434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a62f8-a758-49ee-a9f3-e814b2253590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:15.602816 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7b3a62f8-a758-49ee-a9f3-e814b2253590 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:15.604375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7b3a62f8-a758-49ee-a9f3-e814b2253590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:15.670336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a760ba-deb6-44c1-aead-4dcaf25f9efe None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:15.730475 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 303/604] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:15.734759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1a7a-3378-4486-b938-3e89a3b6619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:15.735624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1a7a-3378-4486-b938-3e89a3b6619f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:15.736160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1a7a-3378-4486-b938-3e89a3b6619f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:15.736693 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1a7a-3378-4486-b938-3e89a3b6619f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:15.780015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:15.831785 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff1a7a-3378-4486-b938-3e89a3b6619f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:15.833579 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff1a7a-3378-4486-b938-3e89a3b6619f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:15.947089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 302/605] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:48:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 14:48:15.952734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a62f8-a758-49ee-a9f3-e814b2253590 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:16.038739 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1a7a-3378-4486-b938-3e89a3b6619f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:16.099799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a62f8-a758-49ee-a9f3-e814b2253590 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:16.106129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:16.134816 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:16.175764 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffb5bd-e041-4eac-8cff-6aa09db68c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:16.176418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffb5bd-e041-4eac-8cff-6aa09db68c23 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:16.176697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffb5bd-e041-4eac-8cff-6aa09db68c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:16.176971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffb5bd-e041-4eac-8cff-6aa09db68c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:16.198609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffb5bd-e041-4eac-8cff-6aa09db68c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:16.200081 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffb5bd-e041-4eac-8cff-6aa09db68c23 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:16.218784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1a7a-3378-4486-b938-3e89a3b6619f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d6ffb5bd-e041-4eac-8cff-6aa09db68c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:16.232885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:16.233896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:16.234757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:16.234757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:16.234757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:16.236678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 304/606] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:16.242755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffb5bd-e041-4eac-8cff-6aa09db68c23 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:16.279497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf589c-714a-42ef-8cc7-049dc09aec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:16.280391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf589c-714a-42ef-8cc7-049dc09aec6b None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:16.280666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf589c-714a-42ef-8cc7-049dc09aec6b None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:16.280928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf589c-714a-42ef-8cc7-049dc09aec6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:16.307126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf589c-714a-42ef-8cc7-049dc09aec6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-2faf589c-714a-42ef-8cc7-049dc09aec6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:48:16.312954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:16.313895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:16.314717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:16.314717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:16.314717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:16.314717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:16.314717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:48:16.314717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:48:16.314717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:48:16.314717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:48:16.314717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:48:16.314717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:48:16.314717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:48:16.314717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:16.317219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 303/607] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:48:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:16.318623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db704b10-79b8-4dfc-ba09-7db791e52a6d None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:16.319166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db704b10-79b8-4dfc-ba09-7db791e52a6d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:16.324705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db704b10-79b8-4dfc-ba09-7db791e52a6d None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:16.328017 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 304/608] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:16.328964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db704b10-79b8-4dfc-ba09-7db791e52a6d None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:16.361314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffb5bd-e041-4eac-8cff-6aa09db68c23 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:16.405680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14796688-80f4-463f-944d-a6352a5cc578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:16.406284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14796688-80f4-463f-944d-a6352a5cc578 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:16.406558 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14796688-80f4-463f-944d-a6352a5cc578 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:16.406825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14796688-80f4-463f-944d-a6352a5cc578 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:16.407459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14796688-80f4-463f-944d-a6352a5cc578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:16.407759 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14796688-80f4-463f-944d-a6352a5cc578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:16.409122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14796688-80f4-463f-944d-a6352a5cc578 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:16.422705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 305/609] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:16.424016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a783f0-2009-4b95-bd9b-22bdbdac369e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:16.424298 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a783f0-2009-4b95-bd9b-22bdbdac369e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:16.424571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a783f0-2009-4b95-bd9b-22bdbdac369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:16.442982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-28a783f0-2009-4b95-bd9b-22bdbdac369e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:16.444262 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-28a783f0-2009-4b95-bd9b-22bdbdac369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:16.464681 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db704b10-79b8-4dfc-ba09-7db791e52a6d None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:16.468375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:16.486209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:16.504196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922356a9-f6b5-434b-a0cb-97b85625d4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:16.504853 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922356a9-f6b5-434b-a0cb-97b85625d4fb None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:16.505137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922356a9-f6b5-434b-a0cb-97b85625d4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:16.505432 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922356a9-f6b5-434b-a0cb-97b85625d4fb None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:16.507029 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922356a9-f6b5-434b-a0cb-97b85625d4fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:16.507029 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922356a9-f6b5-434b-a0cb-97b85625d4fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:16.508494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922356a9-f6b5-434b-a0cb-97b85625d4fb None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:16.522318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 306/611] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:16.523636 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a783f0-2009-4b95-bd9b-22bdbdac369e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:16.525763 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 305/611] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:48:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:16.526864 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922356a9-f6b5-434b-a0cb-97b85625d4fb None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:16.644232 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a783f0-2009-4b95-bd9b-22bdbdac369e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:16.684477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d4435-e873-4878-96eb-bd5e0c2f1714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:16.685786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4435-e873-4878-96eb-bd5e0c2f1714 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:16.686305 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4435-e873-4878-96eb-bd5e0c2f1714 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:16.686786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4435-e873-4878-96eb-bd5e0c2f1714 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:16.695782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d4435-e873-4878-96eb-bd5e0c2f1714 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:16.697837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d4435-e873-4878-96eb-bd5e0c2f1714 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-719d4435-e873-4878-96eb-bd5e0c2f1714 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:16.712519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:16.713560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:16.714454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:16.714454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:16.714454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:16.714454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:16.714454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:16.714454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:16.714454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:16.714454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:16.717048 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 307/612] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:16.722627 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d4435-e873-4878-96eb-bd5e0c2f1714 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:16.735362 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922356a9-f6b5-434b-a0cb-97b85625d4fb None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:16.749913 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:16.818635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189d8c5-07cc-459f-86b1-cd782aa5a436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:16.819906 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189d8c5-07cc-459f-86b1-cd782aa5a436 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:16.820187 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189d8c5-07cc-459f-86b1-cd782aa5a436 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:16.820452 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189d8c5-07cc-459f-86b1-cd782aa5a436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:16.832045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189d8c5-07cc-459f-86b1-cd782aa5a436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:16.833623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189d8c5-07cc-459f-86b1-cd782aa5a436 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:16.844164 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d4435-e873-4878-96eb-bd5e0c2f1714 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-4189d8c5-07cc-459f-86b1-cd782aa5a436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:16.848844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:16.849858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:16.851292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:16.851292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:16.851292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:16.851292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 306/613] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:16.852188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f63d24-7c18-44fe-bcfe-8300493e3c64 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:16.852188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f63d24-7c18-44fe-bcfe-8300493e3c64 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:16.852188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f63d24-7c18-44fe-bcfe-8300493e3c64 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:16.857392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 307/614] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:16.858240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f63d24-7c18-44fe-bcfe-8300493e3c64 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:16.891556 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d127c-1c43-4465-9dc6-0d5c81385d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:16.892838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d127c-1c43-4465-9dc6-0d5c81385d3f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:16.893460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:16.893875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d127c-1c43-4465-9dc6-0d5c81385d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:16.895133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d127c-1c43-4465-9dc6-0d5c81385d3f None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:16.896100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d127c-1c43-4465-9dc6-0d5c81385d3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:16.896616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d127c-1c43-4465-9dc6-0d5c81385d3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:16.899434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d127c-1c43-4465-9dc6-0d5c81385d3f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:16.914771 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 308/615] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:48:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:16.916283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2115e1f-5358-497a-96a4-fcc34c9a3401 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:16.916765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2115e1f-5358-497a-96a4-fcc34c9a3401 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:16.917217 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2115e1f-5358-497a-96a4-fcc34c9a3401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:16.942991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b2115e1f-5358-497a-96a4-fcc34c9a3401 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:16.947080 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b2115e1f-5358-497a-96a4-fcc34c9a3401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:16.986379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f63d24-7c18-44fe-bcfe-8300493e3c64 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:17.023553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c140a-881c-4100-929e-8c29735a6c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:17.024177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c140a-881c-4100-929e-8c29735a6c00 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.024452 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c140a-881c-4100-929e-8c29735a6c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.024719 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c140a-881c-4100-929e-8c29735a6c00 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.025411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c140a-881c-4100-929e-8c29735a6c00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:17.025713 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c140a-881c-4100-929e-8c29735a6c00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:17.027129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c140a-881c-4100-929e-8c29735a6c00 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:17.032647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 309/616] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:17.033894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2115e1f-5358-497a-96a4-fcc34c9a3401 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:17.043360 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 308/617] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:17.044077 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c140a-881c-4100-929e-8c29735a6c00 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:17.057901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:17.159426 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:17.159731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2115e1f-5358-497a-96a4-fcc34c9a3401 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:17.168977 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c140a-881c-4100-929e-8c29735a6c00 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:17.198221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009f86b-331f-4ca4-b1b1-f7472d1a1b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:17.198818 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009f86b-331f-4ca4-b1b1-f7472d1a1b50 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.199093 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009f86b-331f-4ca4-b1b1-f7472d1a1b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.199369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009f86b-331f-4ca4-b1b1-f7472d1a1b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.200076 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009f86b-331f-4ca4-b1b1-f7472d1a1b50 None admin] RBAC: Adding query filter params (role.id=bc1117423b4841a4ae3e7be8f54af3b7, scope.project.id=b82a0373e3b649f3a023efd8db204123, user.id=439bd5d7fd094326aa92bcc5057fcc89) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:17.200385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009f86b-331f-4ca4-b1b1-f7472d1a1b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:17.201823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009f86b-331f-4ca4-b1b1-f7472d1a1b50 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:17.204394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dad738-57bb-469a-9444-c3f43988aed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:17.205040 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dad738-57bb-469a-9444-c3f43988aed3 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.205352 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dad738-57bb-469a-9444-c3f43988aed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.205628 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dad738-57bb-469a-9444-c3f43988aed3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.206206 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dad738-57bb-469a-9444-c3f43988aed3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:17.207570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dad738-57bb-469a-9444-c3f43988aed3 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:17.208066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 310/618] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:48:17 2022] GET /identity/v3/role_assignments?user.id=439bd5d7fd094326aa92bcc5057fcc89&scope.project.id=b82a0373e3b649f3a023efd8db204123&role.id=bc1117423b4841a4ae3e7be8f54af3b7 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:17.208896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009f86b-331f-4ca4-b1b1-f7472d1a1b50 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-b1dad738-57bb-469a-9444-c3f43988aed3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:17.227845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:17.229363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 31 14:48:17.230228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:17.234159 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 309/619] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:17 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:17.235605 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19909e3f-f2cf-42f5-b009-4bf9e16d73c4 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.235870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19909e3f-f2cf-42f5-b009-4bf9e16d73c4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.236138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19909e3f-f2cf-42f5-b009-4bf9e16d73c4 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.237504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 310/620] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:17.238258 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19909e3f-f2cf-42f5-b009-4bf9e16d73c4 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:17.309348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:17.344753 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009f86b-331f-4ca4-b1b1-f7472d1a1b50 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:17.386184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19909e3f-f2cf-42f5-b009-4bf9e16d73c4 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:17.387220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6601e9c-02f7-4ca8-931d-da7a1009421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:17.387864 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6601e9c-02f7-4ca8-931d-da7a1009421f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.388496 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6601e9c-02f7-4ca8-931d-da7a1009421f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.388496 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6601e9c-02f7-4ca8-931d-da7a1009421f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.396453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6601e9c-02f7-4ca8-931d-da7a1009421f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:17.398701 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6601e9c-02f7-4ca8-931d-da7a1009421f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c6601e9c-02f7-4ca8-931d-da7a1009421f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:48:17.411765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:17.412693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:17.413821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:17.413821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:17.413821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:48:17.413821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:48:17.413821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:48:17.413821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:48:17.413821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:48:17.413821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:48:17.413821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 31 14:48:17.413821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:17.413821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 311/621] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:48:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:17.414767 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac974407-16f4-4292-95c3-c9239c7bd279 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.415048 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac974407-16f4-4292-95c3-c9239c7bd279 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.415317 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac974407-16f4-4292-95c3-c9239c7bd279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.431272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada2d57-f838-4dc2-ae98-9563186132e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:17.431887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada2d57-f838-4dc2-ae98-9563186132e2 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.432167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada2d57-f838-4dc2-ae98-9563186132e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.432436 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada2d57-f838-4dc2-ae98-9563186132e2 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.433131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada2d57-f838-4dc2-ae98-9563186132e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:17.433544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada2d57-f838-4dc2-ae98-9563186132e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:17.434021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ac974407-16f4-4292-95c3-c9239c7bd279 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:17.434961 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada2d57-f838-4dc2-ae98-9563186132e2 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:17.435214 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ac974407-16f4-4292-95c3-c9239c7bd279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:17.440454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 311/622] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 31 14:48:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:17.441247 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada2d57-f838-4dc2-ae98-9563186132e2 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:17.462357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:17.521313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 312/623] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:17.521313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac974407-16f4-4292-95c3-c9239c7bd279 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:17.561906 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada2d57-f838-4dc2-ae98-9563186132e2 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:17.600374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78693d-18b8-422d-a6bb-e655a6b83342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:17.601025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78693d-18b8-422d-a6bb-e655a6b83342 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.601669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:17.601915 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78693d-18b8-422d-a6bb-e655a6b83342 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.602374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78693d-18b8-422d-a6bb-e655a6b83342 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.603857 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78693d-18b8-422d-a6bb-e655a6b83342 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:17.605494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78693d-18b8-422d-a6bb-e655a6b83342 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-af78693d-18b8-422d-a6bb-e655a6b83342 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:17.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:17.619270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:17.620099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 312/624] 10.222.0.45 () {56 vars in 1129 bytes} [Mon Oct 31 14:48:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:17.621812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78693d-18b8-422d-a6bb-e655a6b83342 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:17.649862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac974407-16f4-4292-95c3-c9239c7bd279 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:17.705108 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49e558-550b-4d67-9307-1a39e30b8e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:17.705818 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49e558-550b-4d67-9307-1a39e30b8e2f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.706204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49e558-550b-4d67-9307-1a39e30b8e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.706566 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49e558-550b-4d67-9307-1a39e30b8e2f None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.707395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49e558-550b-4d67-9307-1a39e30b8e2f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:17.707794 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49e558-550b-4d67-9307-1a39e30b8e2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:17.710398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49e558-550b-4d67-9307-1a39e30b8e2f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:17.717609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:17.739074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 313/625] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Oct 31 14:48:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:17.739530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78693d-18b8-422d-a6bb-e655a6b83342 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:17.740487 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49e558-550b-4d67-9307-1a39e30b8e2f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:17.782043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd192cf5-072d-4ca4-baeb-afebdbb28912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:17.782738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd192cf5-072d-4ca4-baeb-afebdbb28912 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.783087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd192cf5-072d-4ca4-baeb-afebdbb28912 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.783381 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd192cf5-072d-4ca4-baeb-afebdbb28912 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.784080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd192cf5-072d-4ca4-baeb-afebdbb28912 None admin] RBAC: Adding query filter params (type=network) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:17.784385 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd192cf5-072d-4ca4-baeb-afebdbb28912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:17.785954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd192cf5-072d-4ca4-baeb-afebdbb28912 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:17.792357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 313/626] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 31 14:48:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:17.793239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd192cf5-072d-4ca4-baeb-afebdbb28912 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:17.862576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49e558-550b-4d67-9307-1a39e30b8e2f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:17.884347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:17.899771 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4199e9a-216d-494c-84b5-1be2e1685f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:17.900493 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4199e9a-216d-494c-84b5-1be2e1685f97 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.900766 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4199e9a-216d-494c-84b5-1be2e1685f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.901037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4199e9a-216d-494c-84b5-1be2e1685f97 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.901705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4199e9a-216d-494c-84b5-1be2e1685f97 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:17.901993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4199e9a-216d-494c-84b5-1be2e1685f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:17.903635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4199e9a-216d-494c-84b5-1be2e1685f97 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:17.906355 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd192cf5-072d-4ca4-baeb-afebdbb28912 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:17.913328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 314/627] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Oct 31 14:48:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:17.913861 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4199e9a-216d-494c-84b5-1be2e1685f97 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:17.941695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d2d25-0f69-476a-bedc-b09d73cf92b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:17.942300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d2d25-0f69-476a-bedc-b09d73cf92b2 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:17.942583 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d2d25-0f69-476a-bedc-b09d73cf92b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:17.942860 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d2d25-0f69-476a-bedc-b09d73cf92b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:17.958484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:18.019417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d2d25-0f69-476a-bedc-b09d73cf92b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:18.021030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d2d25-0f69-476a-bedc-b09d73cf92b2 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:18.027402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4199e9a-216d-494c-84b5-1be2e1685f97 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:18.065195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4581df-1703-427f-8a1c-325b1a2fe8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:18.067040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4581df-1703-427f-8a1c-325b1a2fe8db None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:18.067040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4581df-1703-427f-8a1c-325b1a2fe8db None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:18.067040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4581df-1703-427f-8a1c-325b1a2fe8db None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:18.068880 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4581df-1703-427f-8a1c-325b1a2fe8db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:18.070874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4581df-1703-427f-8a1c-325b1a2fe8db None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:18.125581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 314/628] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:48:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 14:48:18.126400 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d2d25-0f69-476a-bedc-b09d73cf92b2 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:18.177576 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:18.180263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 315/629] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:17 2022] POST /identity/v3/endpoints => generated 337 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:18.181834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4581df-1703-427f-8a1c-325b1a2fe8db None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:18.243260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:18.250527 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d2d25-0f69-476a-bedc-b09d73cf92b2 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:18.295479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984b9e8-3c68-4c46-a1a0-fb1a5c0f7cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:18.296262 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b9e8-3c68-4c46-a1a0-fb1a5c0f7cac None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:18.296571 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b9e8-3c68-4c46-a1a0-fb1a5c0f7cac None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:18.296911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984b9e8-3c68-4c46-a1a0-fb1a5c0f7cac None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:18.297705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984b9e8-3c68-4c46-a1a0-fb1a5c0f7cac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:18.299204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984b9e8-3c68-4c46-a1a0-fb1a5c0f7cac None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:18.323825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4581df-1703-427f-8a1c-325b1a2fe8db None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:18.362303 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2d87a-e15e-4011-b2f5-27211d816aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:18.362928 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2d87a-e15e-4011-b2f5-27211d816aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:18.363205 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2d87a-e15e-4011-b2f5-27211d816aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:18.363474 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2d87a-e15e-4011-b2f5-27211d816aa4 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:18.364113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2d87a-e15e-4011-b2f5-27211d816aa4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:18.364412 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2d87a-e15e-4011-b2f5-27211d816aa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:18.366543 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2d87a-e15e-4011-b2f5-27211d816aa4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:18.378019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 316/630] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Oct 31 14:48:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:18.378019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2d87a-e15e-4011-b2f5-27211d816aa4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:18.432711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 315/631] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:48:18 2022] POST /identity/v3/services => generated 269 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:18.434570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984b9e8-3c68-4c46-a1a0-fb1a5c0f7cac None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:18.510635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2d87a-e15e-4011-b2f5-27211d816aa4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:18.514154 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:18.573892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b88dd-b636-4692-bab0-5ac830febe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:18.574671 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b88dd-b636-4692-bab0-5ac830febe48 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:18.575235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b88dd-b636-4692-bab0-5ac830febe48 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:18.575513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b88dd-b636-4692-bab0-5ac830febe48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:18.588480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984b9e8-3c68-4c46-a1a0-fb1a5c0f7cac None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:18.590109 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b88dd-b636-4692-bab0-5ac830febe48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:18.590351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:18.592604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b88dd-b636-4692-bab0-5ac830febe48 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-622b88dd-b636-4692-bab0-5ac830febe48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:18.610778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:18.612113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:18.612994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:18.612994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:18.612994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:18.612994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 317/632] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:18.619227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b88dd-b636-4692-bab0-5ac830febe48 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:18.635389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac0c2f-0942-4689-911b-6aaea29b6aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:18.635389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0c2f-0942-4689-911b-6aaea29b6aca None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:18.635679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0c2f-0942-4689-911b-6aaea29b6aca None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:18.635679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0c2f-0942-4689-911b-6aaea29b6aca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:18.636438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac0c2f-0942-4689-911b-6aaea29b6aca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:18.638006 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac0c2f-0942-4689-911b-6aaea29b6aca None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:18.735141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b88dd-b636-4692-bab0-5ac830febe48 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:18.759255 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 316/633] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:18.786088 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b421477-41b8-4015-8411-073abd4c72b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:18.786811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b421477-41b8-4015-8411-073abd4c72b6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:18.787187 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b421477-41b8-4015-8411-073abd4c72b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:18.787554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b421477-41b8-4015-8411-073abd4c72b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:18.789342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b421477-41b8-4015-8411-073abd4c72b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:18.789928 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b421477-41b8-4015-8411-073abd4c72b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:18.791526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b421477-41b8-4015-8411-073abd4c72b6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:18.806195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 318/634] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:18.811791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac0c2f-0942-4689-911b-6aaea29b6aca None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:18.937897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac0c2f-0942-4689-911b-6aaea29b6aca None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:18.985995 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad5914-6344-4b0a-aa1e-2f74bc6431eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:18.986631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad5914-6344-4b0a-aa1e-2f74bc6431eb None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:18.986905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad5914-6344-4b0a-aa1e-2f74bc6431eb None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:18.987171 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad5914-6344-4b0a-aa1e-2f74bc6431eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:18.994438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad5914-6344-4b0a-aa1e-2f74bc6431eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:18.995876 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad5914-6344-4b0a-aa1e-2f74bc6431eb None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-a0ad5914-6344-4b0a-aa1e-2f74bc6431eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:19.008569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:19.009549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:19.010897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:19.010897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:19.010897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:19.010897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:19.010897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:19.010897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:19.010897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:19.010897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:19.010897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 317/635] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:19.015448 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b421477-41b8-4015-8411-073abd4c72b6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:19.028160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:19.119853 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b421477-41b8-4015-8411-073abd4c72b6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:19.154215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d7ef7-a83b-4a7a-a88d-d4db90b2eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:19.154824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d7ef7-a83b-4a7a-a88d-d4db90b2eddb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:19.155101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d7ef7-a83b-4a7a-a88d-d4db90b2eddb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:19.155621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d7ef7-a83b-4a7a-a88d-d4db90b2eddb None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:19.156301 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d7ef7-a83b-4a7a-a88d-d4db90b2eddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:19.156602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d7ef7-a83b-4a7a-a88d-d4db90b2eddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:19.158033 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d7ef7-a83b-4a7a-a88d-d4db90b2eddb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:19.170370 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 319/636] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:48:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:19.176100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad5914-6344-4b0a-aa1e-2f74bc6431eb None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:19.197069 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:19.284506 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad5914-6344-4b0a-aa1e-2f74bc6431eb None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:19.324833 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3f62f-151d-4fe5-8554-3d2255fcb5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:19.325472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3f62f-151d-4fe5-8554-3d2255fcb5df None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:19.325746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3f62f-151d-4fe5-8554-3d2255fcb5df None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:19.326014 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3f62f-151d-4fe5-8554-3d2255fcb5df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:19.326813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3f62f-151d-4fe5-8554-3d2255fcb5df None admin] RBAC: Adding query filter params (role.id=c62ffefc63e74a1280bef2b6a22202ad, scope.project.id=b82a0373e3b649f3a023efd8db204123, user.id=93cb8e24b84d4c26bf5fd58d93ebb6c4) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:19.327116 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3f62f-151d-4fe5-8554-3d2255fcb5df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:19.328637 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3f62f-151d-4fe5-8554-3d2255fcb5df None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:19.336835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 318/637] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:48:19 2022] GET /identity/v3/role_assignments?user.id=93cb8e24b84d4c26bf5fd58d93ebb6c4&scope.project.id=b82a0373e3b649f3a023efd8db204123&role.id=c62ffefc63e74a1280bef2b6a22202ad => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:19.461836 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63012221-4cb8-46b0-a9e7-ce5ce5d17771 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:19.462345 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63012221-4cb8-46b0-a9e7-ce5ce5d17771 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:19.462345 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63012221-4cb8-46b0-a9e7-ce5ce5d17771 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:19.463963 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 320/638] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:19.469138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956ed2d-dcde-4167-b825-a476d041bf52 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:19.469451 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956ed2d-dcde-4167-b825-a476d041bf52 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:19.469726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956ed2d-dcde-4167-b825-a476d041bf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:19.489451 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0956ed2d-dcde-4167-b825-a476d041bf52 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:19.490669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0956ed2d-dcde-4167-b825-a476d041bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:19.566818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 319/639] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:19 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:19.833053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63012221-4cb8-46b0-a9e7-ce5ce5d17771 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:19.901519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:19.941095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63012221-4cb8-46b0-a9e7-ce5ce5d17771 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:19.979937 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e16cd-4511-4c4b-b035-01ac99741b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:19.979937 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e16cd-4511-4c4b-b035-01ac99741b42 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:19.979937 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e16cd-4511-4c4b-b035-01ac99741b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:19.979937 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e16cd-4511-4c4b-b035-01ac99741b42 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:19.989856 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e16cd-4511-4c4b-b035-01ac99741b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-e32e16cd-4511-4c4b-b035-01ac99741b42 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:48:19.995810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:19.996717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:19.997739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:19.997739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:19.997739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:19.997739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:19.997739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:48:19.997739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:48:19.997739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:48:19.997739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:48:19.997739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:48:19.997739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:48:19.997739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 14:48:19.997739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:19.997739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 321/640] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Oct 31 14:48:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:20.002704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956ed2d-dcde-4167-b825-a476d041bf52 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:20.017124 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:20.105219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956ed2d-dcde-4167-b825-a476d041bf52 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:20.140327 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285a842-0671-463c-ab28-5c67b97c8531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:20.140939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285a842-0671-463c-ab28-5c67b97c8531 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:20.141214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285a842-0671-463c-ab28-5c67b97c8531 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:20.141503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285a842-0671-463c-ab28-5c67b97c8531 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:20.142162 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285a842-0671-463c-ab28-5c67b97c8531 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:20.142459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285a842-0671-463c-ab28-5c67b97c8531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:20.143811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285a842-0671-463c-ab28-5c67b97c8531 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:20.153074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 320/641] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Oct 31 14:48:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:20.158854 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e16cd-4511-4c4b-b035-01ac99741b42 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:20.259684 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e16cd-4511-4c4b-b035-01ac99741b42 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:20.291092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:20.298962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a59fa-9450-4fc8-9229-e56cab4381e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:20.299592 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a59fa-9450-4fc8-9229-e56cab4381e4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:20.299867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a59fa-9450-4fc8-9229-e56cab4381e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:20.300135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a59fa-9450-4fc8-9229-e56cab4381e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:20.311268 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a59fa-9450-4fc8-9229-e56cab4381e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:20.312727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a59fa-9450-4fc8-9229-e56cab4381e4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d24a59fa-9450-4fc8-9229-e56cab4381e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:20.328117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:20.330557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:20.332595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:20.332595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:20.332595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:20.332595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 322/642] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:20.338865 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285a842-0671-463c-ab28-5c67b97c8531 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:20.417829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:20.442292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285a842-0671-463c-ab28-5c67b97c8531 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:20.478117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1143e59-065b-4ea1-99b1-c96221eb394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:20.478715 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1143e59-065b-4ea1-99b1-c96221eb394d None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:20.479023 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1143e59-065b-4ea1-99b1-c96221eb394d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:20.479289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1143e59-065b-4ea1-99b1-c96221eb394d None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:20.479974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1143e59-065b-4ea1-99b1-c96221eb394d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:20.480269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1143e59-065b-4ea1-99b1-c96221eb394d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:20.481660 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1143e59-065b-4ea1-99b1-c96221eb394d None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:20.494478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 321/643] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:20.500015 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a59fa-9450-4fc8-9229-e56cab4381e4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:20.605444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a59fa-9450-4fc8-9229-e56cab4381e4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:20.640307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe80ab0-a3b7-45d5-8602-c999aaec0719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:20.641218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe80ab0-a3b7-45d5-8602-c999aaec0719 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:20.641694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe80ab0-a3b7-45d5-8602-c999aaec0719 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:20.642144 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe80ab0-a3b7-45d5-8602-c999aaec0719 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:20.650883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe80ab0-a3b7-45d5-8602-c999aaec0719 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:20.652673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe80ab0-a3b7-45d5-8602-c999aaec0719 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-3fe80ab0-a3b7-45d5-8602-c999aaec0719 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:48:20.666151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:20.667342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:20.668571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:20.668571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:20.668571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:48:20.668571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:48:20.668571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:48:20.668571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:48:20.668571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:48:20.668571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:48:20.668571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 14:48:20.668571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:20.670844 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 323/644] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 31 14:48:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:20.676991 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1143e59-065b-4ea1-99b1-c96221eb394d None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:20.784680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c57d7-5aed-4a6f-857d-3ff8f9ff621e None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:20.785005 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c57d7-5aed-4a6f-857d-3ff8f9ff621e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:20.785220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c57d7-5aed-4a6f-857d-3ff8f9ff621e None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:20.786702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 324/645] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:48:20.788190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1143e59-065b-4ea1-99b1-c96221eb394d None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:20.791959 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e06d2d-55e2-4d39-9e3e-d7e6d03724ce None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:20.792318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e06d2d-55e2-4d39-9e3e-d7e6d03724ce None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:20.792541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e06d2d-55e2-4d39-9e3e-d7e6d03724ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:20.811352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b6e06d2d-55e2-4d39-9e3e-d7e6d03724ce None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:20.812557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b6e06d2d-55e2-4d39-9e3e-d7e6d03724ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:20.824699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5381951-1db6-4164-a04f-6afe2ec742c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:20.825311 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381951-1db6-4164-a04f-6afe2ec742c5 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:20.825599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381951-1db6-4164-a04f-6afe2ec742c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:20.825862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5381951-1db6-4164-a04f-6afe2ec742c5 None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5381951-1db6-4164-a04f-6afe2ec742c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:20.826990 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5381951-1db6-4164-a04f-6afe2ec742c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:20.828522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5381951-1db6-4164-a04f-6afe2ec742c5 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:20.830180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:20.848262 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 322/646] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Oct 31 14:48:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:20.849764 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:20.853990 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5381951-1db6-4164-a04f-6afe2ec742c5 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:20.886403 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 325/647] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:20 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:20.955614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5381951-1db6-4164-a04f-6afe2ec742c5 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:20.990261 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f349f93-9959-4083-b244-b854e61c4814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:20.990929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f349f93-9959-4083-b244-b854e61c4814 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:20.991203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f349f93-9959-4083-b244-b854e61c4814 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:20.991471 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f349f93-9959-4083-b244-b854e61c4814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.001627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f349f93-9959-4083-b244-b854e61c4814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:21.003056 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f349f93-9959-4083-b244-b854e61c4814 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-2f349f93-9959-4083-b244-b854e61c4814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:21.018497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:21.019519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:21.020392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:21.020392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:21.020392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:21.020392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 323/648] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:21.025879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e06d2d-55e2-4d39-9e3e-d7e6d03724ce None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:21.130764 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e06d2d-55e2-4d39-9e3e-d7e6d03724ce None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:21.141967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373320a-d191-422a-8aa6-0df97be0b382 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.142320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373320a-d191-422a-8aa6-0df97be0b382 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.142660 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373320a-d191-422a-8aa6-0df97be0b382 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.144330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 324/649] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:21.149534 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d207b6-dc87-4b19-b42b-5373167a8d3d None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.149880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d207b6-dc87-4b19-b42b-5373167a8d3d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.150217 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d207b6-dc87-4b19-b42b-5373167a8d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.167419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b1514-846f-4f85-97ec-0440f6f11ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:21.168305 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b1514-846f-4f85-97ec-0440f6f11ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.168761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b1514-846f-4f85-97ec-0440f6f11ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.169201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b1514-846f-4f85-97ec-0440f6f11ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.169534 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-95d207b6-dc87-4b19-b42b-5373167a8d3d None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:21.170296 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b1514-846f-4f85-97ec-0440f6f11ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:21.170773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b1514-846f-4f85-97ec-0440f6f11ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:21.170989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-95d207b6-dc87-4b19-b42b-5373167a8d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:21.172474 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b1514-846f-4f85-97ec-0440f6f11ff8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:21.184867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 326/650] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:21.193345 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b1514-846f-4f85-97ec-0440f6f11ff8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:21.215459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:21.221096 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:21.245452 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 325/651] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:21 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:21.245452 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d207b6-dc87-4b19-b42b-5373167a8d3d None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:21.293355 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b1514-846f-4f85-97ec-0440f6f11ff8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:21.328537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa6b44-f297-4b1b-a302-6e68d929dcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:21.329434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6b44-f297-4b1b-a302-6e68d929dcbd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.329857 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6b44-f297-4b1b-a302-6e68d929dcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.330269 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6b44-f297-4b1b-a302-6e68d929dcbd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.331018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa6b44-f297-4b1b-a302-6e68d929dcbd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:21.332511 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa6b44-f297-4b1b-a302-6e68d929dcbd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-dffa6b44-f297-4b1b-a302-6e68d929dcbd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:21.341899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:21.342879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 14:48:21.343749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:21.351113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 327/652] 10.222.0.45 () {56 vars in 1132 bytes} [Mon Oct 31 14:48:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:21.352570 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa6b44-f297-4b1b-a302-6e68d929dcbd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:21.357894 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d207b6-dc87-4b19-b42b-5373167a8d3d None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:21.396895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3dbd4-4116-4bdf-b93f-212a9ac23888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:21.398196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3dbd4-4116-4bdf-b93f-212a9ac23888 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.398766 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3dbd4-4116-4bdf-b93f-212a9ac23888 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.398923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3dbd4-4116-4bdf-b93f-212a9ac23888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.406831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3dbd4-4116-4bdf-b93f-212a9ac23888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:21.408458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3dbd4-4116-4bdf-b93f-212a9ac23888 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-eef3dbd4-4116-4bdf-b93f-212a9ac23888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:21.421695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:21.422581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:21.423607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:21.423607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:21.423607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:21.423607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:21.423607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:21.423607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:21.423607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:21.423607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:21.423607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 326/653] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:21.428857 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3dbd4-4116-4bdf-b93f-212a9ac23888 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:21.454900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:21.462716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa6b44-f297-4b1b-a302-6e68d929dcbd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:21.471736 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:21.498280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f096-b7d5-4eaf-b7c9-38efa7df0508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:21.500466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f096-b7d5-4eaf-b7c9-38efa7df0508 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.500466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f096-b7d5-4eaf-b7c9-38efa7df0508 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.500466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f096-b7d5-4eaf-b7c9-38efa7df0508 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.500466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602f096-b7d5-4eaf-b7c9-38efa7df0508 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:21.501511 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602f096-b7d5-4eaf-b7c9-38efa7df0508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:21.503103 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602f096-b7d5-4eaf-b7c9-38efa7df0508 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:21.512801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 328/654] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 31 14:48:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:21.514344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f096-b7d5-4eaf-b7c9-38efa7df0508 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:21.548921 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3dbd4-4116-4bdf-b93f-212a9ac23888 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:21.583395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200d1bc-8845-40dd-aecb-cf15c11be4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:21.583994 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200d1bc-8845-40dd-aecb-cf15c11be4bc None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.584266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200d1bc-8845-40dd-aecb-cf15c11be4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.585129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200d1bc-8845-40dd-aecb-cf15c11be4bc None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.585996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200d1bc-8845-40dd-aecb-cf15c11be4bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:21.586296 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200d1bc-8845-40dd-aecb-cf15c11be4bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:21.587712 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200d1bc-8845-40dd-aecb-cf15c11be4bc None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:21.599165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 327/655] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:48:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:21.600022 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200d1bc-8845-40dd-aecb-cf15c11be4bc None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:21.633201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f096-b7d5-4eaf-b7c9-38efa7df0508 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:21.675095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb10ccf-391d-40ea-ac58-6cfd29962e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:21.676119 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb10ccf-391d-40ea-ac58-6cfd29962e86 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.676648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb10ccf-391d-40ea-ac58-6cfd29962e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.677065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb10ccf-391d-40ea-ac58-6cfd29962e86 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.677989 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb10ccf-391d-40ea-ac58-6cfd29962e86 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:21.679068 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb10ccf-391d-40ea-ac58-6cfd29962e86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:21.680442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb10ccf-391d-40ea-ac58-6cfd29962e86 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:21.689662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 329/656] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 31 14:48:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:21.690862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb10ccf-391d-40ea-ac58-6cfd29962e86 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:21.703367 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:21.710822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200d1bc-8845-40dd-aecb-cf15c11be4bc None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:21.717780 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:21.749730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1abd65-8f3b-4cb7-b988-1d8ff5117f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:21.750271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1abd65-8f3b-4cb7-b988-1d8ff5117f11 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.750544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1abd65-8f3b-4cb7-b988-1d8ff5117f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.750804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1abd65-8f3b-4cb7-b988-1d8ff5117f11 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.751370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1abd65-8f3b-4cb7-b988-1d8ff5117f11 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:21.752760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1abd65-8f3b-4cb7-b988-1d8ff5117f11 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-fb1abd65-8f3b-4cb7-b988-1d8ff5117f11 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:21.761791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:21.762834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:21.763673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 328/657] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:48:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:21.764449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1abd65-8f3b-4cb7-b988-1d8ff5117f11 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:21.800285 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb10ccf-391d-40ea-ac58-6cfd29962e86 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:21.833486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138489a5-92d6-4513-8ca8-52daf21b1ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:21.834133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138489a5-92d6-4513-8ca8-52daf21b1ca4 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.834409 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138489a5-92d6-4513-8ca8-52daf21b1ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.835283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138489a5-92d6-4513-8ca8-52daf21b1ca4 None admin] PATH_INFO: `/v3/projects/b82a0373e3b649f3a023efd8db204123/users/439bd5d7fd094326aa92bcc5057fcc89/roles/0b9c6ffe14ae4031b903136ad93d0474` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.837433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138489a5-92d6-4513-8ca8-52daf21b1ca4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b82a0373e3b649f3a023efd8db204123, user_id=439bd5d7fd094326aa92bcc5057fcc89, role_id=0b9c6ffe14ae4031b903136ad93d0474)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:21.845645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138489a5-92d6-4513-8ca8-52daf21b1ca4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:21.862176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1abd65-8f3b-4cb7-b988-1d8ff5117f11 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:21.895381 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1861a99-b3ed-4b2a-9b18-9a6baf347fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:21.895971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1861a99-b3ed-4b2a-9b18-9a6baf347fdb None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.896246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1861a99-b3ed-4b2a-9b18-9a6baf347fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.896515 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1861a99-b3ed-4b2a-9b18-9a6baf347fdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.897835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1861a99-b3ed-4b2a-9b18-9a6baf347fdb None admin] RBAC: Adding query filter params (interface=public, service_id=c2c98a6854a84d4c812c1dae227b051f, region_id=RegionOne) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:21.898200 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1861a99-b3ed-4b2a-9b18-9a6baf347fdb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:21.899548 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1861a99-b3ed-4b2a-9b18-9a6baf347fdb None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:21.904345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 329/658] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 31 14:48:21 2022] GET /identity/v3/endpoints?service_id=c2c98a6854a84d4c812c1dae227b051f&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:21.905879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ad171-5742-4946-a236-8d9d31764ad5 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:21.906157 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ad171-5742-4946-a236-8d9d31764ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:21.906425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ad171-5742-4946-a236-8d9d31764ad5 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:21.907600 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 330/659] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:21.908342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ad171-5742-4946-a236-8d9d31764ad5 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:21.931721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:21.944867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 330/660] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:48:21 2022] PUT /identity/v3/projects/b82a0373e3b649f3a023efd8db204123/users/439bd5d7fd094326aa92bcc5057fcc89/roles/0b9c6ffe14ae4031b903136ad93d0474 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:21.948835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138489a5-92d6-4513-8ca8-52daf21b1ca4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:22.027218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ad171-5742-4946-a236-8d9d31764ad5 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:22.056749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:22.066701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45ef66-acbd-48c7-94af-874e2338b7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:22.067317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45ef66-acbd-48c7-94af-874e2338b7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:22.067590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45ef66-acbd-48c7-94af-874e2338b7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:22.067870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45ef66-acbd-48c7-94af-874e2338b7d4 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:22.068494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45ef66-acbd-48c7-94af-874e2338b7d4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:22.068794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45ef66-acbd-48c7-94af-874e2338b7d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:22.070946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45ef66-acbd-48c7-94af-874e2338b7d4 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:22.076440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 331/661] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:48:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:22.081592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6770917-cda9-4963-a233-e8166f278abb None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:22.081592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6770917-cda9-4963-a233-e8166f278abb None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:22.081592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6770917-cda9-4963-a233-e8166f278abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:22.084216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138489a5-92d6-4513-8ca8-52daf21b1ca4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:22.098462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-b6770917-cda9-4963-a233-e8166f278abb None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:22.099687 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b6770917-cda9-4963-a233-e8166f278abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:22.124167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4094c2b-ab38-4052-9eec-8809cb93ed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:22.124886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4094c2b-ab38-4052-9eec-8809cb93ed3f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:22.125156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4094c2b-ab38-4052-9eec-8809cb93ed3f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:22.125465 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4094c2b-ab38-4052-9eec-8809cb93ed3f None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:22.126072 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4094c2b-ab38-4052-9eec-8809cb93ed3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:22.127454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4094c2b-ab38-4052-9eec-8809cb93ed3f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:22.136196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 331/662] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 31 14:48:21 2022] GET /identity/v3/services => generated 1029 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:22.137421 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4094c2b-ab38-4052-9eec-8809cb93ed3f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:22.178954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 332/663] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:22 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:22.262451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4094c2b-ab38-4052-9eec-8809cb93ed3f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:22.301774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6f96d-5273-47d8-b335-6aecba5723fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:22.302378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6f96d-5273-47d8-b335-6aecba5723fd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:22.302670 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6f96d-5273-47d8-b335-6aecba5723fd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:22.302926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6f96d-5273-47d8-b335-6aecba5723fd None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:22.304101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6f96d-5273-47d8-b335-6aecba5723fd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:22.304398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6f96d-5273-47d8-b335-6aecba5723fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:22.305797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6f96d-5273-47d8-b335-6aecba5723fd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:22.311127 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 332/664] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:48:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:22.453637 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6770917-cda9-4963-a233-e8166f278abb None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:22.474095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:22.560877 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6770917-cda9-4963-a233-e8166f278abb None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:22.597225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af3e98-9b25-4f5c-9208-f3b9348eb156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:22.598244 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af3e98-9b25-4f5c-9208-f3b9348eb156 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:22.598740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af3e98-9b25-4f5c-9208-f3b9348eb156 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:22.599204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af3e98-9b25-4f5c-9208-f3b9348eb156 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:22.599976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af3e98-9b25-4f5c-9208-f3b9348eb156 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:22.602147 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af3e98-9b25-4f5c-9208-f3b9348eb156 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-88af3e98-9b25-4f5c-9208-f3b9348eb156 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:22.612129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:22.613237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:22.614111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:22.616900 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 333/665] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 31 14:48:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:22.625339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6f96d-5273-47d8-b335-6aecba5723fd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:22.640124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:22.733884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6f96d-5273-47d8-b335-6aecba5723fd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:22.769667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1925c45-0c53-45f1-81b5-aa96779dd8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:22.770378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1925c45-0c53-45f1-81b5-aa96779dd8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:22.770878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1925c45-0c53-45f1-81b5-aa96779dd8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:22.771214 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1925c45-0c53-45f1-81b5-aa96779dd8b8 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:22.771933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1925c45-0c53-45f1-81b5-aa96779dd8b8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:22.772333 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1925c45-0c53-45f1-81b5-aa96779dd8b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:22.773899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1925c45-0c53-45f1-81b5-aa96779dd8b8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:22.779101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 333/666] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 31 14:48:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:22.784915 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af3e98-9b25-4f5c-9208-f3b9348eb156 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:22.871211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:22.891285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af3e98-9b25-4f5c-9208-f3b9348eb156 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:22.930292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42465abd-2af4-4a94-980c-a028949ae51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:22.930903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42465abd-2af4-4a94-980c-a028949ae51e None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:22.931191 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42465abd-2af4-4a94-980c-a028949ae51e None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:22.931488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42465abd-2af4-4a94-980c-a028949ae51e None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:22.932123 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42465abd-2af4-4a94-980c-a028949ae51e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:22.932425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42465abd-2af4-4a94-980c-a028949ae51e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:22.933825 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42465abd-2af4-4a94-980c-a028949ae51e None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:22.938860 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 334/667] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 31 14:48:22 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:24.176920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58c20-f605-496b-9445-9520ae9cb5c3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.177501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58c20-f605-496b-9445-9520ae9cb5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.177501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58c20-f605-496b-9445-9520ae9cb5c3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.179347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 334/668] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:24.184876 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c77005-4e1e-4165-a2f1-60e19a63ea64 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.185663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c77005-4e1e-4165-a2f1-60e19a63ea64 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.186076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c77005-4e1e-4165-a2f1-60e19a63ea64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.205207 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-99c77005-4e1e-4165-a2f1-60e19a63ea64 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:24.206645 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-99c77005-4e1e-4165-a2f1-60e19a63ea64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:24.285462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 335/669] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:24 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:24.362229 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2969f-2778-4414-8908-174a27dc411c None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.362504 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2969f-2778-4414-8908-174a27dc411c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.362773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2969f-2778-4414-8908-174a27dc411c None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.364344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 335/670] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:24.370143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0db5cd-b1d9-47de-828f-4197323ce561 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.370661 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0db5cd-b1d9-47de-828f-4197323ce561 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.371133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0db5cd-b1d9-47de-828f-4197323ce561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.389926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-ea0db5cd-b1d9-47de-828f-4197323ce561 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:24.391490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ea0db5cd-b1d9-47de-828f-4197323ce561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:24.461678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 336/671] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:24 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:24.559781 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2969f-2778-4414-8908-174a27dc411c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:24.587634 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaf934-1e01-485e-b5c7-c6fea7d6cc9a None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.587942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaf934-1e01-485e-b5c7-c6fea7d6cc9a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.588178 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaf934-1e01-485e-b5c7-c6fea7d6cc9a None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.589802 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 337/672] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:48:24.594620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34258a26-57e3-4783-a937-3f848e8f5e18 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.594903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34258a26-57e3-4783-a937-3f848e8f5e18 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.595175 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34258a26-57e3-4783-a937-3f848e8f5e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.602769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:24.613654 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-34258a26-57e3-4783-a937-3f848e8f5e18 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:24.615008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-34258a26-57e3-4783-a937-3f848e8f5e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:24.646700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:24.672185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2969f-2778-4414-8908-174a27dc411c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:24.689395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 338/673] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:24 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:24.709063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc02c53-6022-4088-8936-2f7cda793b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:24.710346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc02c53-6022-4088-8936-2f7cda793b5b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.710818 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc02c53-6022-4088-8936-2f7cda793b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.711180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc02c53-6022-4088-8936-2f7cda793b5b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.722128 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc02c53-6022-4088-8936-2f7cda793b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8bc02c53-6022-4088-8936-2f7cda793b5b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:48:24.727385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:24.728319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:24.729155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:24.729155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:24.729155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:24.729155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:24.729155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:48:24.729155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:48:24.729155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:48:24.729155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:48:24.729155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:48:24.729155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:48:24.729155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 14:48:24.729155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:24.733415 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 336/674] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Oct 31 14:48:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:24.734733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34258a26-57e3-4783-a937-3f848e8f5e18 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:24.747407 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc02c53-6022-4088-8936-2f7cda793b5b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:24.847711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34258a26-57e3-4783-a937-3f848e8f5e18 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:24.863141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc02c53-6022-4088-8936-2f7cda793b5b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:24.895567 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16bf6d-3680-49cd-adca-d310a7759437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:24.896196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16bf6d-3680-49cd-adca-d310a7759437 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.896471 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16bf6d-3680-49cd-adca-d310a7759437 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.896737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16bf6d-3680-49cd-adca-d310a7759437 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.897852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16bf6d-3680-49cd-adca-d310a7759437 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:24.898200 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16bf6d-3680-49cd-adca-d310a7759437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:24.900269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16bf6d-3680-49cd-adca-d310a7759437 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:24.901645 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:24.904449 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cd9e4-db43-40f4-90cb-ed98e988d754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:24.905586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cd9e4-db43-40f4-90cb-ed98e988d754 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:24.906092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cd9e4-db43-40f4-90cb-ed98e988d754 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:24.906555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cd9e4-db43-40f4-90cb-ed98e988d754 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:24.907332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cd9e4-db43-40f4-90cb-ed98e988d754 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:24.908936 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cd9e4-db43-40f4-90cb-ed98e988d754 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:24.913363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 339/675] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Oct 31 14:48:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:24.915829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:24.917304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16bf6d-3680-49cd-adca-d310a7759437 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-eb5cd9e4-db43-40f4-90cb-ed98e988d754 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:24.922736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:24.923652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 31 14:48:24.924531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:24.926948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 337/676] 10.222.0.45 () {56 vars in 1132 bytes} [Mon Oct 31 14:48:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:24.933091 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cd9e4-db43-40f4-90cb-ed98e988d754 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.034066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16bf6d-3680-49cd-adca-d310a7759437 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.048120 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cd9e4-db43-40f4-90cb-ed98e988d754 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.072641 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33960a-95eb-43b0-a601-1492ce45d668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.073279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33960a-95eb-43b0-a601-1492ce45d668 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.073578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33960a-95eb-43b0-a601-1492ce45d668 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.073844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33960a-95eb-43b0-a601-1492ce45d668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.085799 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33960a-95eb-43b0-a601-1492ce45d668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.087338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7043136-65cf-434e-874f-2b4e86c378d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.087462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33960a-95eb-43b0-a601-1492ce45d668 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.087939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7043136-65cf-434e-874f-2b4e86c378d7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.088215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7043136-65cf-434e-874f-2b4e86c378d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.088483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7043136-65cf-434e-874f-2b4e86c378d7 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.089302 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7043136-65cf-434e-874f-2b4e86c378d7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:25.089605 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7043136-65cf-434e-874f-2b4e86c378d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.091251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7043136-65cf-434e-874f-2b4e86c378d7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.101336 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 338/677] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 31 14:48:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:25.101336 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7043136-65cf-434e-874f-2b4e86c378d7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-6a33960a-95eb-43b0-a601-1492ce45d668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:25.101923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:25.102792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:25.103669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:25.103669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:25.103669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:25.103669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 340/678] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:25.104271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33960a-95eb-43b0-a601-1492ce45d668 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.155980 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:25.170138 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:25.207654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7043136-65cf-434e-874f-2b4e86c378d7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.208280 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33960a-95eb-43b0-a601-1492ce45d668 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.241895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b36eec-19fd-461d-941b-37d84e7a8bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.242107 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1419eb-7d29-40c1-b422-361a0886bc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.242496 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36eec-19fd-461d-941b-37d84e7a8bd4 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.242594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1419eb-7d29-40c1-b422-361a0886bc1e None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.242768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1419eb-7d29-40c1-b422-361a0886bc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.242863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36eec-19fd-461d-941b-37d84e7a8bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.243035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b36eec-19fd-461d-941b-37d84e7a8bd4 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.243123 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1419eb-7d29-40c1-b422-361a0886bc1e None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.243653 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1419eb-7d29-40c1-b422-361a0886bc1e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:25.243748 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b36eec-19fd-461d-941b-37d84e7a8bd4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.243952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1419eb-7d29-40c1-b422-361a0886bc1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.245006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b36eec-19fd-461d-941b-37d84e7a8bd4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.245317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1419eb-7d29-40c1-b422-361a0886bc1e None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.250141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 341/679] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 31 14:48:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:25.250911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1419eb-7d29-40c1-b422-361a0886bc1e None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.311338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 339/680] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:48:25 2022] POST /identity/v3/services => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:25.313017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be8782-bb8d-4eb6-b50a-61a1a911ea49 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.313397 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be8782-bb8d-4eb6-b50a-61a1a911ea49 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.313651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be8782-bb8d-4eb6-b50a-61a1a911ea49 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.314925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 340/681] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:25.315570 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be8782-bb8d-4eb6-b50a-61a1a911ea49 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.361673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1419eb-7d29-40c1-b422-361a0886bc1e None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.380162 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:25.412302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb837069-16bb-4cbf-b3da-d1e9951d4461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.414018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb837069-16bb-4cbf-b3da-d1e9951d4461 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.414258 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb837069-16bb-4cbf-b3da-d1e9951d4461 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.414516 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb837069-16bb-4cbf-b3da-d1e9951d4461 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.415163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb837069-16bb-4cbf-b3da-d1e9951d4461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:25.415459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb837069-16bb-4cbf-b3da-d1e9951d4461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.416840 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb837069-16bb-4cbf-b3da-d1e9951d4461 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.430191 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 342/682] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:25.436535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e759102-25d8-43b1-b649-d47e2f4d0110 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.436535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e759102-25d8-43b1-b649-d47e2f4d0110 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.436844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e759102-25d8-43b1-b649-d47e2f4d0110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.447920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be8782-bb8d-4eb6-b50a-61a1a911ea49 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.456073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-9e759102-25d8-43b1-b649-d47e2f4d0110 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:25.457310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9e759102-25d8-43b1-b649-d47e2f4d0110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:25.473426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:25.487009 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8ab41-ca7c-4ba6-9cc3-3d9ac96fd19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.487692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8ab41-ca7c-4ba6-9cc3-3d9ac96fd19a None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.487968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8ab41-ca7c-4ba6-9cc3-3d9ac96fd19a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.488234 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8ab41-ca7c-4ba6-9cc3-3d9ac96fd19a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.488905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8ab41-ca7c-4ba6-9cc3-3d9ac96fd19a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.490295 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8ab41-ca7c-4ba6-9cc3-3d9ac96fd19a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.535010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 343/683] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:25.536072 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e759102-25d8-43b1-b649-d47e2f4d0110 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.580228 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 341/684] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:25.660994 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:25.665609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e759102-25d8-43b1-b649-d47e2f4d0110 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.712926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87080ef6-38fc-4362-b70f-76ae7ace83bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.713594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87080ef6-38fc-4362-b70f-76ae7ace83bb None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.713864 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87080ef6-38fc-4362-b70f-76ae7ace83bb None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.714126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87080ef6-38fc-4362-b70f-76ae7ace83bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.723030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87080ef6-38fc-4362-b70f-76ae7ace83bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.724578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87080ef6-38fc-4362-b70f-76ae7ace83bb None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-87080ef6-38fc-4362-b70f-76ae7ace83bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:48:25.739642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:25.740689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:25.741633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:25.741633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:25.741633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:48:25.741633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:48:25.741633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:48:25.741633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:48:25.741633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:48:25.741633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:48:25.741633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 31 14:48:25.741633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:25.741633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 344/685] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 31 14:48:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:25.747058 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8ab41-ca7c-4ba6-9cc3-3d9ac96fd19a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.819065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87080ef6-38fc-4362-b70f-76ae7ace83bb None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.888143 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8ab41-ca7c-4ba6-9cc3-3d9ac96fd19a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.936000 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cd7fc-0b14-4de8-adbf-c0d5f396c693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.936957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cd7fc-0b14-4de8-adbf-c0d5f396c693 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.937486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cd7fc-0b14-4de8-adbf-c0d5f396c693 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.937962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cd7fc-0b14-4de8-adbf-c0d5f396c693 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.938984 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cd7fc-0b14-4de8-adbf-c0d5f396c693 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:25.939096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87080ef6-38fc-4362-b70f-76ae7ace83bb None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:25.939285 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cd7fc-0b14-4de8-adbf-c0d5f396c693 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.942472 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cd7fc-0b14-4de8-adbf-c0d5f396c693 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:25.965055 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 342/686] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Oct 31 14:48:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:25.976909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cd7fc-0b14-4de8-adbf-c0d5f396c693 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:25.989828 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae982bf-a809-4c1a-9923-dac8cb3766cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:25.991474 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae982bf-a809-4c1a-9923-dac8cb3766cc None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:25.991894 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae982bf-a809-4c1a-9923-dac8cb3766cc None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:25.992372 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae982bf-a809-4c1a-9923-dac8cb3766cc None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:25.993269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae982bf-a809-4c1a-9923-dac8cb3766cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:25.994814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae982bf-a809-4c1a-9923-dac8cb3766cc None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:26.022012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:26.095607 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cd7fc-0b14-4de8-adbf-c0d5f396c693 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:26.101324 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 345/687] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:48:25 2022] POST /identity/v3/services => generated 241 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:26.153899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d3144-b53f-4999-954d-e3bbf5f634c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:26.154526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d3144-b53f-4999-954d-e3bbf5f634c7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:26.154810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d3144-b53f-4999-954d-e3bbf5f634c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:26.155077 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d3144-b53f-4999-954d-e3bbf5f634c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:26.255971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d3144-b53f-4999-954d-e3bbf5f634c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:26.257678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d3144-b53f-4999-954d-e3bbf5f634c7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:26.298991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:26.385472 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 343/688] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:48:25 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 14:48:26.387549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae982bf-a809-4c1a-9923-dac8cb3766cc None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:26.406600 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:26.501326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae982bf-a809-4c1a-9923-dac8cb3766cc None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:26.544823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62c618-ceb0-468c-991c-d32a7f60416f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:26.545403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62c618-ceb0-468c-991c-d32a7f60416f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:26.545682 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62c618-ceb0-468c-991c-d32a7f60416f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:26.545954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62c618-ceb0-468c-991c-d32a7f60416f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:26.558908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62c618-ceb0-468c-991c-d32a7f60416f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:26.560358 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62c618-ceb0-468c-991c-d32a7f60416f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-6d62c618-ceb0-468c-991c-d32a7f60416f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:26.578074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:26.579055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:26.580034 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:26.580034 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:26.580034 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:26.580453 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 346/689] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:26.587509 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d3144-b53f-4999-954d-e3bbf5f634c7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:26.703159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d3144-b53f-4999-954d-e3bbf5f634c7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:26.733992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:26.739352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d4aae-d515-49c7-bca3-0f69811022f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:26.740209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d4aae-d515-49c7-bca3-0f69811022f0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:26.741247 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d4aae-d515-49c7-bca3-0f69811022f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:26.742026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d4aae-d515-49c7-bca3-0f69811022f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:26.742916 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d4aae-d515-49c7-bca3-0f69811022f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:26.743432 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d4aae-d515-49c7-bca3-0f69811022f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:26.744982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d4aae-d515-49c7-bca3-0f69811022f0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:26.761385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 344/690] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:26.763695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62c618-ceb0-468c-991c-d32a7f60416f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:26.835900 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:26.870205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62c618-ceb0-468c-991c-d32a7f60416f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:26.904838 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd9cdd-c5ad-4ac7-b9c9-e987ce2a5275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:26.905827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd9cdd-c5ad-4ac7-b9c9-e987ce2a5275 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:26.906103 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd9cdd-c5ad-4ac7-b9c9-e987ce2a5275 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:26.906367 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd9cdd-c5ad-4ac7-b9c9-e987ce2a5275 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:26.913431 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd9cdd-c5ad-4ac7-b9c9-e987ce2a5275 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:26.914919 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd9cdd-c5ad-4ac7-b9c9-e987ce2a5275 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-6bbd9cdd-c5ad-4ac7-b9c9-e987ce2a5275 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:26.926826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:26.927745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:26.929205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:26.929205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:26.929205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:26.929205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:26.929205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:26.929205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:26.929205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:26.929205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:26.933509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 347/691] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:26.934866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d4aae-d515-49c7-bca3-0f69811022f0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:27.045230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d4aae-d515-49c7-bca3-0f69811022f0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:27.081243 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc365fda-b6dd-4f1b-afb5-e727d6cbca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:27.081884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc365fda-b6dd-4f1b-afb5-e727d6cbca4a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:27.082158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc365fda-b6dd-4f1b-afb5-e727d6cbca4a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:27.082433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc365fda-b6dd-4f1b-afb5-e727d6cbca4a None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:27.083118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc365fda-b6dd-4f1b-afb5-e727d6cbca4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:27.083419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc365fda-b6dd-4f1b-afb5-e727d6cbca4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:27.084957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc365fda-b6dd-4f1b-afb5-e727d6cbca4a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:27.103498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 345/692] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:48:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:27.104757 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd9cdd-c5ad-4ac7-b9c9-e987ce2a5275 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:27.212686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd9cdd-c5ad-4ac7-b9c9-e987ce2a5275 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:27.239074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:27.248117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a0539-5d21-46e8-89cd-5dd4358e922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:27.248720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a0539-5d21-46e8-89cd-5dd4358e922d None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:27.249049 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a0539-5d21-46e8-89cd-5dd4358e922d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:27.249342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a0539-5d21-46e8-89cd-5dd4358e922d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:27.250112 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a0539-5d21-46e8-89cd-5dd4358e922d None admin] RBAC: Adding query filter params (role.id=0b9c6ffe14ae4031b903136ad93d0474, scope.project.id=b82a0373e3b649f3a023efd8db204123, user.id=439bd5d7fd094326aa92bcc5057fcc89) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:27.250419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a0539-5d21-46e8-89cd-5dd4358e922d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:27.251853 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a0539-5d21-46e8-89cd-5dd4358e922d None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:27.258798 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 348/693] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:48:27 2022] GET /identity/v3/role_assignments?user.id=439bd5d7fd094326aa92bcc5057fcc89&scope.project.id=b82a0373e3b649f3a023efd8db204123&role.id=0b9c6ffe14ae4031b903136ad93d0474 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:27.620892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c740a5-ebcd-4577-a15b-7d66ad20afc8 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:27.621469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c740a5-ebcd-4577-a15b-7d66ad20afc8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:27.621469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c740a5-ebcd-4577-a15b-7d66ad20afc8 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:27.623204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 346/694] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:27.628436 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc887b-76a4-433e-a58d-31fe04267ad1 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:27.628851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc887b-76a4-433e-a58d-31fe04267ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:27.629002 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc887b-76a4-433e-a58d-31fe04267ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:27.648394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-05dc887b-76a4-433e-a58d-31fe04267ad1 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:27.649638 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-05dc887b-76a4-433e-a58d-31fe04267ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:27.724061 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 349/695] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:27.994870 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c740a5-ebcd-4577-a15b-7d66ad20afc8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.053063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:28.073834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6f073-cac5-4df1-94dc-548433e182db None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.074465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6f073-cac5-4df1-94dc-548433e182db None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.074935 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6f073-cac5-4df1-94dc-548433e182db None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.076731 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 350/696] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:28.082885 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9475a9c-ba4e-4d47-ab3c-f821d19ccb74 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.083164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9475a9c-ba4e-4d47-ab3c-f821d19ccb74 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.083598 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9475a9c-ba4e-4d47-ab3c-f821d19ccb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.102305 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e9475a9c-ba4e-4d47-ab3c-f821d19ccb74 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:28.103823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e9475a9c-ba4e-4d47-ab3c-f821d19ccb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:28.107990 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c740a5-ebcd-4577-a15b-7d66ad20afc8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.146177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e344267-806f-4456-b2b6-ac2c441cb5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.147423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e344267-806f-4456-b2b6-ac2c441cb5cf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.147856 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e344267-806f-4456-b2b6-ac2c441cb5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.148267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e344267-806f-4456-b2b6-ac2c441cb5cf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.149057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e344267-806f-4456-b2b6-ac2c441cb5cf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.150716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e344267-806f-4456-b2b6-ac2c441cb5cf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5e344267-806f-4456-b2b6-ac2c441cb5cf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:28.160813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:28.162035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 14:48:28.163687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:28.166204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 347/697] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:48:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:28.172487 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e344267-806f-4456-b2b6-ac2c441cb5cf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.181866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 351/698] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:28.281652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e344267-806f-4456-b2b6-ac2c441cb5cf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.298546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:28.317643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f17f99-6b56-4d10-9d1d-38c6bbc02b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.318471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f17f99-6b56-4d10-9d1d-38c6bbc02b77 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.318971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f17f99-6b56-4d10-9d1d-38c6bbc02b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.319425 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f17f99-6b56-4d10-9d1d-38c6bbc02b77 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.331628 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f17f99-6b56-4d10-9d1d-38c6bbc02b77 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:28.331628 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f17f99-6b56-4d10-9d1d-38c6bbc02b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.331628 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f17f99-6b56-4d10-9d1d-38c6bbc02b77 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.331628 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 348/699] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:48:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:28.332841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9475a9c-ba4e-4d47-ab3c-f821d19ccb74 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.393349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:28.446509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9475a9c-ba4e-4d47-ab3c-f821d19ccb74 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.477017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f17f99-6b56-4d10-9d1d-38c6bbc02b77 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.483064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9a64b-c570-435c-8977-914e0510f27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.483668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9a64b-c570-435c-8977-914e0510f27f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.483996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9a64b-c570-435c-8977-914e0510f27f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.484265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9a64b-c570-435c-8977-914e0510f27f None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.484891 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9a64b-c570-435c-8977-914e0510f27f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:28.485182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9a64b-c570-435c-8977-914e0510f27f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.486567 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9a64b-c570-435c-8977-914e0510f27f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.491876 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 352/700] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:48:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:28.496345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fcf46-d0b2-4b06-ab22-34ac4f154b6b None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.496624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fcf46-d0b2-4b06-ab22-34ac4f154b6b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.496896 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fcf46-d0b2-4b06-ab22-34ac4f154b6b None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.498528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 353/701] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:28.499065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fcf46-d0b2-4b06-ab22-34ac4f154b6b None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.591331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f17f99-6b56-4d10-9d1d-38c6bbc02b77 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.611739 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fcf46-d0b2-4b06-ab22-34ac4f154b6b None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.627055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:28.628562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff99102-a3e5-4dfc-b969-d273c11dee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.629192 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99102-a3e5-4dfc-b969-d273c11dee91 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.629497 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99102-a3e5-4dfc-b969-d273c11dee91 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.629772 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99102-a3e5-4dfc-b969-d273c11dee91 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.630350 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff99102-a3e5-4dfc-b969-d273c11dee91 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.632230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff99102-a3e5-4dfc-b969-d273c11dee91 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-aff99102-a3e5-4dfc-b969-d273c11dee91 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:28.641528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:28.644167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:28.644995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 349/702] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:28.645834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674244bb-92c1-4784-b4ce-3f238f534cf9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.645834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674244bb-92c1-4784-b4ce-3f238f534cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.645834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674244bb-92c1-4784-b4ce-3f238f534cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.654810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b8450-e8d4-4b20-9805-5be834c5cdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.656202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b8450-e8d4-4b20-9805-5be834c5cdb2 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.656625 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b8450-e8d4-4b20-9805-5be834c5cdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.657473 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b8450-e8d4-4b20-9805-5be834c5cdb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.658597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b8450-e8d4-4b20-9805-5be834c5cdb2 None admin] RBAC: Adding query filter params (interface=public, service_id=a4b0f85ec55848978a05d31cc91a4f20, region_id=RegionOne) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:28.659073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b8450-e8d4-4b20-9805-5be834c5cdb2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.660580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b8450-e8d4-4b20-9805-5be834c5cdb2 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.662256 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-674244bb-92c1-4784-b4ce-3f238f534cf9 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:28.664095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-674244bb-92c1-4784-b4ce-3f238f534cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:28.667991 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 354/703] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 31 14:48:28 2022] GET /identity/v3/endpoints?service_id=a4b0f85ec55848978a05d31cc91a4f20&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:28.668934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b8450-e8d4-4b20-9805-5be834c5cdb2 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.708023 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:28.735040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 350/704] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:28.736254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674244bb-92c1-4784-b4ce-3f238f534cf9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.789465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b8450-e8d4-4b20-9805-5be834c5cdb2 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.835673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedce3d-b7af-407e-8a35-2415259189ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.837230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedce3d-b7af-407e-8a35-2415259189ad None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.837730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedce3d-b7af-407e-8a35-2415259189ad None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.838229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedce3d-b7af-407e-8a35-2415259189ad None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.839275 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedce3d-b7af-407e-8a35-2415259189ad None admin] RBAC: Adding query filter params (name=compute) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:28.839832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedce3d-b7af-407e-8a35-2415259189ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.843670 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedce3d-b7af-407e-8a35-2415259189ad None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.846024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674244bb-92c1-4784-b4ce-3f238f534cf9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:28.847289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 355/705] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 31 14:48:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:28.853913 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedce3d-b7af-407e-8a35-2415259189ad None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:28.888435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f8f6-a873-4fb3-809b-ad97e89d3714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:28.889406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f8f6-a873-4fb3-809b-ad97e89d3714 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:28.890034 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f8f6-a873-4fb3-809b-ad97e89d3714 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:28.890527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f8f6-a873-4fb3-809b-ad97e89d3714 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:28.891360 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1f8f6-a873-4fb3-809b-ad97e89d3714 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:28.892927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1f8f6-a873-4fb3-809b-ad97e89d3714 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:28.900277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 351/706] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 31 14:48:28 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:28.913754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:28.999012 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedce3d-b7af-407e-8a35-2415259189ad None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:29.018863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f8f6-a873-4fb3-809b-ad97e89d3714 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:29.039554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81857d-7062-4f61-8a9e-d26904a2f2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:29.040592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81857d-7062-4f61-8a9e-d26904a2f2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.041040 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81857d-7062-4f61-8a9e-d26904a2f2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.041527 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81857d-7062-4f61-8a9e-d26904a2f2f9 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.042426 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81857d-7062-4f61-8a9e-d26904a2f2f9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:29.042901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81857d-7062-4f61-8a9e-d26904a2f2f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:29.044631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81857d-7062-4f61-8a9e-d26904a2f2f9 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:29.050713 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 356/707] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 31 14:48:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:29.071446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:29.150716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f8f6-a873-4fb3-809b-ad97e89d3714 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:29.190594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3510dcd-48e8-4e5c-ac76-a193af80f443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:29.191550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510dcd-48e8-4e5c-ac76-a193af80f443 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.192013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510dcd-48e8-4e5c-ac76-a193af80f443 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.192454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510dcd-48e8-4e5c-ac76-a193af80f443 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.193313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3510dcd-48e8-4e5c-ac76-a193af80f443 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:29.195234 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3510dcd-48e8-4e5c-ac76-a193af80f443 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f3510dcd-48e8-4e5c-ac76-a193af80f443 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:29.205532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:29.206557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:29.207367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:29.210368 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 352/708] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 31 14:48:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:29.219323 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81857d-7062-4f61-8a9e-d26904a2f2f9 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:29.326734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81857d-7062-4f61-8a9e-d26904a2f2f9 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:29.336138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:29.365912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdccf93-9959-4bdc-a2d6-6588e54e2c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:29.366522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdccf93-9959-4bdc-a2d6-6588e54e2c3e None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.366797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdccf93-9959-4bdc-a2d6-6588e54e2c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.367063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdccf93-9959-4bdc-a2d6-6588e54e2c3e None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.367745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdccf93-9959-4bdc-a2d6-6588e54e2c3e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:29.368190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdccf93-9959-4bdc-a2d6-6588e54e2c3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:29.369612 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdccf93-9959-4bdc-a2d6-6588e54e2c3e None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:29.374979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 357/709] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 31 14:48:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:29.380942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3510dcd-48e8-4e5c-ac76-a193af80f443 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:29.495829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3510dcd-48e8-4e5c-ac76-a193af80f443 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:29.509663 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:29.524405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b978519-90fb-4585-9889-388c0f64ab92 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.524680 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b978519-90fb-4585-9889-388c0f64ab92 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.524947 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b978519-90fb-4585-9889-388c0f64ab92 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.526572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 358/710] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:29.531948 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1c175-2fd1-4d9c-8fb2-243852c45ab5 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.532077 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fd99d-9413-475b-b046-56dc54d4bacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:29.532238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1c175-2fd1-4d9c-8fb2-243852c45ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.532488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1c175-2fd1-4d9c-8fb2-243852c45ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.532671 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fd99d-9413-475b-b046-56dc54d4bacd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.532952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fd99d-9413-475b-b046-56dc54d4bacd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.533224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fd99d-9413-475b-b046-56dc54d4bacd None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.533881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fd99d-9413-475b-b046-56dc54d4bacd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:29.534183 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fd99d-9413-475b-b046-56dc54d4bacd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:29.535756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fd99d-9413-475b-b046-56dc54d4bacd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:29.542221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 353/711] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 31 14:48:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:29.548553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fd99d-9413-475b-b046-56dc54d4bacd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:29.552077 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e8f1c175-2fd1-4d9c-8fb2-243852c45ab5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:29.554333 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e8f1c175-2fd1-4d9c-8fb2-243852c45ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:29.633510 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 359/712] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:29.665188 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fd99d-9413-475b-b046-56dc54d4bacd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:29.699764 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588e274-9543-4383-bb2a-80eb153e86c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:29.700359 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588e274-9543-4383-bb2a-80eb153e86c5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.700631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588e274-9543-4383-bb2a-80eb153e86c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.700897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588e274-9543-4383-bb2a-80eb153e86c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.701611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588e274-9543-4383-bb2a-80eb153e86c5 None admin] RBAC: Adding query filter params (interface=public, service_id=ec205c62ac5b4d2293d0897b7fbc9918, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:29.701911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588e274-9543-4383-bb2a-80eb153e86c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:29.703249 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588e274-9543-4383-bb2a-80eb153e86c5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:29.708560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 354/713] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 31 14:48:29 2022] GET /identity/v3/endpoints?service_id=ec205c62ac5b4d2293d0897b7fbc9918&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:29.714777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1c175-2fd1-4d9c-8fb2-243852c45ab5 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:29.818418 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:29.822633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1c175-2fd1-4d9c-8fb2-243852c45ab5 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:29.857691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67122b6-7d17-4f11-ad6e-020cfb872361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:29.858296 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67122b6-7d17-4f11-ad6e-020cfb872361 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:29.858566 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67122b6-7d17-4f11-ad6e-020cfb872361 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:29.858830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67122b6-7d17-4f11-ad6e-020cfb872361 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:29.859484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67122b6-7d17-4f11-ad6e-020cfb872361 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:29.860846 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67122b6-7d17-4f11-ad6e-020cfb872361 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:29.867705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 360/714] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 31 14:48:29 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:29.934253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588e274-9543-4383-bb2a-80eb153e86c5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:29.972208 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:30.050332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588e274-9543-4383-bb2a-80eb153e86c5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:30.085795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd16ba-9c24-4bed-b7a1-1d40c836faf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:30.086346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd16ba-9c24-4bed-b7a1-1d40c836faf8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:30.086619 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd16ba-9c24-4bed-b7a1-1d40c836faf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:30.086882 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd16ba-9c24-4bed-b7a1-1d40c836faf8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:30.087456 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd16ba-9c24-4bed-b7a1-1d40c836faf8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:30.088797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd16ba-9c24-4bed-b7a1-1d40c836faf8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-b7cd16ba-9c24-4bed-b7a1-1d40c836faf8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:30.097728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:30.100016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:30.102067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 355/715] 10.222.0.45 () {56 vars in 1105 bytes} [Mon Oct 31 14:48:29 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:30.109316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67122b6-7d17-4f11-ad6e-020cfb872361 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:30.209723 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67122b6-7d17-4f11-ad6e-020cfb872361 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:30.245606 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3edc48-9c98-4c8f-9a76-3a20bc7a197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:30.246513 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3edc48-9c98-4c8f-9a76-3a20bc7a197a None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:30.246987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3edc48-9c98-4c8f-9a76-3a20bc7a197a None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:30.247425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3edc48-9c98-4c8f-9a76-3a20bc7a197a None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:30.248245 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3edc48-9c98-4c8f-9a76-3a20bc7a197a None admin] RBAC: Adding query filter params (name=image) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:30.248714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3edc48-9c98-4c8f-9a76-3a20bc7a197a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:30.250267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3edc48-9c98-4c8f-9a76-3a20bc7a197a None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:30.255696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 361/716] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:30.262048 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd16ba-9c24-4bed-b7a1-1d40c836faf8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:30.362633 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:30.370334 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd16ba-9c24-4bed-b7a1-1d40c836faf8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:30.404710 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b475e0-029d-49c5-ad82-e77e57f6fce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:30.405590 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b475e0-029d-49c5-ad82-e77e57f6fce7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:30.405931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b475e0-029d-49c5-ad82-e77e57f6fce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:30.406418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b475e0-029d-49c5-ad82-e77e57f6fce7 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:30.407219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b475e0-029d-49c5-ad82-e77e57f6fce7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:30.407883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b475e0-029d-49c5-ad82-e77e57f6fce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:30.409244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b475e0-029d-49c5-ad82-e77e57f6fce7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:30.414325 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 356/717] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:31.251784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1676b-086d-45cb-beb8-fd28730fd98c None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:31.252280 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1676b-086d-45cb-beb8-fd28730fd98c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:31.252280 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1676b-086d-45cb-beb8-fd28730fd98c None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:31.253833 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 362/718] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:31.259260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5db6c-5694-4a75-9d56-a025d3ad1d9a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:31.259680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5db6c-5694-4a75-9d56-a025d3ad1d9a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:31.259848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5db6c-5694-4a75-9d56-a025d3ad1d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:31.278505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f1a5db6c-5694-4a75-9d56-a025d3ad1d9a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:31.279688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f1a5db6c-5694-4a75-9d56-a025d3ad1d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:31.324104 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb268f-88de-4dac-92fc-068912830caf None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:31.324433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb268f-88de-4dac-92fc-068912830caf None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:31.324649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb268f-88de-4dac-92fc-068912830caf None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:31.326747 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 363/719] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:31.331729 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0c20c-e5c0-464d-a603-49ce0260a0d4 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:31.332011 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0c20c-e5c0-464d-a603-49ce0260a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:31.332282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0c20c-e5c0-464d-a603-49ce0260a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:31.351115 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-77c0c20c-e5c0-464d-a603-49ce0260a0d4 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:31.352301 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-77c0c20c-e5c0-464d-a603-49ce0260a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:31.355485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 357/720] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:31.376143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:31.422021 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 364/721] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:31.637383 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5db6c-5694-4a75-9d56-a025d3ad1d9a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:31.696115 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0c20c-e5c0-464d-a603-49ce0260a0d4 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:31.732646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:31.745119 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5db6c-5694-4a75-9d56-a025d3ad1d9a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:31.781207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dc076-5991-49e2-8b33-6733876de178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:31.782078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dc076-5991-49e2-8b33-6733876de178 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:31.782357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dc076-5991-49e2-8b33-6733876de178 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:31.782626 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dc076-5991-49e2-8b33-6733876de178 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:31.783213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dc076-5991-49e2-8b33-6733876de178 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:31.784582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dc076-5991-49e2-8b33-6733876de178 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-7e2dc076-5991-49e2-8b33-6733876de178 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:31.794942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:31.795969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:31.797271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 358/722] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:48:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:31.801828 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dc076-5991-49e2-8b33-6733876de178 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:31.830274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0c20c-e5c0-464d-a603-49ce0260a0d4 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:31.870485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd5c2b-590d-465e-aafb-a1c76b853e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:31.871425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd5c2b-590d-465e-aafb-a1c76b853e63 None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:31.871865 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd5c2b-590d-465e-aafb-a1c76b853e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:31.872275 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd5c2b-590d-465e-aafb-a1c76b853e63 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:31.873112 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd5c2b-590d-465e-aafb-a1c76b853e63 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:31.874870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd5c2b-590d-465e-aafb-a1c76b853e63 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:31.914628 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dc076-5991-49e2-8b33-6733876de178 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:31.948559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361f6f9-4098-40ba-8578-4e7ce0b53607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:31.949162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361f6f9-4098-40ba-8578-4e7ce0b53607 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:31.949514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361f6f9-4098-40ba-8578-4e7ce0b53607 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:31.949785 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361f6f9-4098-40ba-8578-4e7ce0b53607 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:31.950407 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361f6f9-4098-40ba-8578-4e7ce0b53607 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:31.950707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361f6f9-4098-40ba-8578-4e7ce0b53607 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:31.952061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361f6f9-4098-40ba-8578-4e7ce0b53607 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:31.956955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 359/723] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:48:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:31.962905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361f6f9-4098-40ba-8578-4e7ce0b53607 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:31.982321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:32.034698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 365/724] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:48:31 2022] POST /identity/v3/services => generated 242 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:32.080815 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361f6f9-4098-40ba-8578-4e7ce0b53607 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:32.126512 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e504a1-0a9b-4122-b25d-67847182ae0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:32.127141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e504a1-0a9b-4122-b25d-67847182ae0e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:32.127428 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e504a1-0a9b-4122-b25d-67847182ae0e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:32.127689 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e504a1-0a9b-4122-b25d-67847182ae0e None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:32.128323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e504a1-0a9b-4122-b25d-67847182ae0e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:32.128682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e504a1-0a9b-4122-b25d-67847182ae0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:32.130105 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e504a1-0a9b-4122-b25d-67847182ae0e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:32.136308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 360/725] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Oct 31 14:48:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:32.142535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd5c2b-590d-465e-aafb-a1c76b853e63 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:32.166366 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf794f1a-b760-4443-aad4-05cae9fb80ec None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:32.166559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf794f1a-b760-4443-aad4-05cae9fb80ec None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:32.166823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf794f1a-b760-4443-aad4-05cae9fb80ec None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:32.168418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 361/726] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:32.169374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:32.174075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bc7a4-57df-49a9-a5c5-4387e8ffad79 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:32.174282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bc7a4-57df-49a9-a5c5-4387e8ffad79 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:32.174518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bc7a4-57df-49a9-a5c5-4387e8ffad79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:32.195039 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dc0bc7a4-57df-49a9-a5c5-4387e8ffad79 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:32.196318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dc0bc7a4-57df-49a9-a5c5-4387e8ffad79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:32.279082 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd5c2b-590d-465e-aafb-a1c76b853e63 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:32.286046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 362/727] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:32.320385 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d8d53-96ec-406b-a010-8d97f7b09b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:32.321399 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d8d53-96ec-406b-a010-8d97f7b09b4f None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:32.321877 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d8d53-96ec-406b-a010-8d97f7b09b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:32.322339 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d8d53-96ec-406b-a010-8d97f7b09b4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:32.323230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d8d53-96ec-406b-a010-8d97f7b09b4f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:32.324815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d8d53-96ec-406b-a010-8d97f7b09b4f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:32.430580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 366/728] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:32.556493 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bc7a4-57df-49a9-a5c5-4387e8ffad79 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:32.564853 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:32.649518 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746022-8738-4fac-895a-a469289fdd11 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:32.649939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746022-8738-4fac-895a-a469289fdd11 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:32.650275 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746022-8738-4fac-895a-a469289fdd11 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:32.651830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 367/729] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:48:32.656940 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5e104-0189-4a9e-aebd-fbea886c59ba None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:32.657246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5e104-0189-4a9e-aebd-fbea886c59ba None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:32.657541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5e104-0189-4a9e-aebd-fbea886c59ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:32.667068 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bc7a4-57df-49a9-a5c5-4387e8ffad79 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:32.676315 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f1a5e104-0189-4a9e-aebd-fbea886c59ba None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:32.679166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f1a5e104-0189-4a9e-aebd-fbea886c59ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:32.710949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bc2d4-6636-4a95-9230-83631e30054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:32.711599 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bc2d4-6636-4a95-9230-83631e30054a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:32.711875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bc2d4-6636-4a95-9230-83631e30054a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:32.712246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bc2d4-6636-4a95-9230-83631e30054a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:32.712877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4bc2d4-6636-4a95-9230-83631e30054a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:32.714260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4bc2d4-6636-4a95-9230-83631e30054a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-6e4bc2d4-6636-4a95-9230-83631e30054a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:32.723601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:32.724583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:32.726170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 363/730] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 31 14:48:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:32.735012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bc2d4-6636-4a95-9230-83631e30054a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:32.775006 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 368/731] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:32.810962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:32.849429 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bc2d4-6636-4a95-9230-83631e30054a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:32.886290 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec180391-d857-4387-82a2-a21ea55332ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:32.886897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec180391-d857-4387-82a2-a21ea55332ec None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:32.887223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec180391-d857-4387-82a2-a21ea55332ec None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:32.887494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec180391-d857-4387-82a2-a21ea55332ec None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:32.888116 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec180391-d857-4387-82a2-a21ea55332ec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:32.888414 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec180391-d857-4387-82a2-a21ea55332ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:32.889818 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec180391-d857-4387-82a2-a21ea55332ec None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:32.895356 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 364/732] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 31 14:48:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:32.901590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5e104-0189-4a9e-aebd-fbea886c59ba None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:32.906625 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:33.009043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5e104-0189-4a9e-aebd-fbea886c59ba None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:33.047666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a39df9-b90a-469a-a48d-eb3d45384106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:33.048275 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a39df9-b90a-469a-a48d-eb3d45384106 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:33.048549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a39df9-b90a-469a-a48d-eb3d45384106 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:33.048818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a39df9-b90a-469a-a48d-eb3d45384106 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:33.049479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a39df9-b90a-469a-a48d-eb3d45384106 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:33.049774 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a39df9-b90a-469a-a48d-eb3d45384106 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:33.051133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a39df9-b90a-469a-a48d-eb3d45384106 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:33.056846 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 369/733] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 31 14:48:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:33.062331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec180391-d857-4387-82a2-a21ea55332ec None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:33.084963 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a39df9-b90a-469a-a48d-eb3d45384106 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:33.174467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:33.180093 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec180391-d857-4387-82a2-a21ea55332ec None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:33.210916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a39df9-b90a-469a-a48d-eb3d45384106 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:33.213748 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:33.220415 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81a706-c786-436e-aed3-94bf217549ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:33.221202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a706-c786-436e-aed3-94bf217549ff None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:33.221766 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a706-c786-436e-aed3-94bf217549ff None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:33.222168 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a706-c786-436e-aed3-94bf217549ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:33.222968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81a706-c786-436e-aed3-94bf217549ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:33.225254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81a706-c786-436e-aed3-94bf217549ff None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:33.248991 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c038d7-4d20-4c29-b1c2-7221a36c70ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:33.249656 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c038d7-4d20-4c29-b1c2-7221a36c70ed None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:33.249999 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c038d7-4d20-4c29-b1c2-7221a36c70ed None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:33.250330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c038d7-4d20-4c29-b1c2-7221a36c70ed None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:33.251047 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c038d7-4d20-4c29-b1c2-7221a36c70ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:33.252549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c038d7-4d20-4c29-b1c2-7221a36c70ed None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:33.328907 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 365/734] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:33.368632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 370/735] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:48:33 2022] POST /identity/v3/services => generated 242 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:48:34.340908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31ec1a-6604-4783-9e5f-b3fadb3a5c10 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:34.341454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31ec1a-6604-4783-9e5f-b3fadb3a5c10 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:34.341454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31ec1a-6604-4783-9e5f-b3fadb3a5c10 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:34.342933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 366/736] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:34.347923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47801f41-afd4-4db1-af00-7e005c13603c None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:34.348209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47801f41-afd4-4db1-af00-7e005c13603c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:34.348480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47801f41-afd4-4db1-af00-7e005c13603c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:34.367291 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-47801f41-afd4-4db1-af00-7e005c13603c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:34.368478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-47801f41-afd4-4db1-af00-7e005c13603c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:34.444106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 371/737] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:34 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:34.719498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31ec1a-6604-4783-9e5f-b3fadb3a5c10 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:34.738856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c2467-4efd-44d1-aa72-8cc41f90601c None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:34.739148 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c2467-4efd-44d1-aa72-8cc41f90601c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:34.739403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c2467-4efd-44d1-aa72-8cc41f90601c None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:34.740820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 372/738] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:34.745985 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7552c57-d40b-4e80-8c2c-9c62b051b555 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:34.746258 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7552c57-d40b-4e80-8c2c-9c62b051b555 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:34.746531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7552c57-d40b-4e80-8c2c-9c62b051b555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:34.767029 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f7552c57-d40b-4e80-8c2c-9c62b051b555 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:34.768206 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f7552c57-d40b-4e80-8c2c-9c62b051b555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:34.822490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:34.836691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31ec1a-6604-4783-9e5f-b3fadb3a5c10 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:34.849411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 373/739] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:34 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:34.872659 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5ae27-8ec0-4e85-b8ab-1212135a72fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:34.873301 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5ae27-8ec0-4e85-b8ab-1212135a72fb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:34.873587 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5ae27-8ec0-4e85-b8ab-1212135a72fb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:34.873922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5ae27-8ec0-4e85-b8ab-1212135a72fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:34.874500 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5ae27-8ec0-4e85-b8ab-1212135a72fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:34.875852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5ae27-8ec0-4e85-b8ab-1212135a72fb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-9dc5ae27-8ec0-4e85-b8ab-1212135a72fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:34.884631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:34.885801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:34.886685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 367/740] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:34.891985 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7552c57-d40b-4e80-8c2c-9c62b051b555 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:34.994913 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7552c57-d40b-4e80-8c2c-9c62b051b555 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:35.031447 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15ff31-4549-46e3-a802-05ac0b126185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:35.032055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15ff31-4549-46e3-a802-05ac0b126185 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.032331 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15ff31-4549-46e3-a802-05ac0b126185 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.032600 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15ff31-4549-46e3-a802-05ac0b126185 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.033225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15ff31-4549-46e3-a802-05ac0b126185 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:35.033550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15ff31-4549-46e3-a802-05ac0b126185 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:35.034919 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15ff31-4549-46e3-a802-05ac0b126185 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:35.040588 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 374/741] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 31 14:48:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:35.046247 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5ae27-8ec0-4e85-b8ab-1212135a72fb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:35.098812 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:35.140222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15ff31-4549-46e3-a802-05ac0b126185 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:35.154338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5ae27-8ec0-4e85-b8ab-1212135a72fb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:35.197102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:35.201306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da63cb-a99e-4937-80f7-99814eb7717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:35.201972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da63cb-a99e-4937-80f7-99814eb7717b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.202442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da63cb-a99e-4937-80f7-99814eb7717b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.203151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da63cb-a99e-4937-80f7-99814eb7717b None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.203792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da63cb-a99e-4937-80f7-99814eb7717b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:35.204169 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da63cb-a99e-4937-80f7-99814eb7717b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:35.205988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da63cb-a99e-4937-80f7-99814eb7717b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:35.213012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 368/742] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 31 14:48:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:35.220069 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da63cb-a99e-4937-80f7-99814eb7717b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:35.279044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15ff31-4549-46e3-a802-05ac0b126185 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:35.324421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d68d9-ee3c-48cb-820a-e59117a723b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:35.325317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d68d9-ee3c-48cb-820a-e59117a723b6 None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.325601 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d68d9-ee3c-48cb-820a-e59117a723b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.325875 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d68d9-ee3c-48cb-820a-e59117a723b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.326996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d68d9-ee3c-48cb-820a-e59117a723b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:35.328918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d68d9-ee3c-48cb-820a-e59117a723b6 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:35.332225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: WARNING keystone.server.flask.common [None req-9c0d68d9-ee3c-48cb-820a-e59117a723b6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 31 14:48:35.350598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da63cb-a99e-4937-80f7-99814eb7717b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:35.367496 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:35.388405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79819b14-a002-45ad-a0cf-9893eec409e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:35.389268 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79819b14-a002-45ad-a0cf-9893eec409e6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.389825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79819b14-a002-45ad-a0cf-9893eec409e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.390275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79819b14-a002-45ad-a0cf-9893eec409e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.391214 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79819b14-a002-45ad-a0cf-9893eec409e6 None admin] RBAC: Adding query filter params (interface=public, service_id=1561a01e6ab844ba9a6218faa0b648e5, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:35.391706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79819b14-a002-45ad-a0cf-9893eec409e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:35.393273 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79819b14-a002-45ad-a0cf-9893eec409e6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:35.395936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.sql.core [None req-9c0d68d9-ee3c-48cb-820a-e59117a723b6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 14:48:35.395936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 14:48:35.395936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [parameters: {'id': '1fcbe58c6057445982f0d5ab86742d0c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 14:48:35.395936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81684) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 14:48:35.406533 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 369/743] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 31 14:48:35 2022] GET /identity/v3/endpoints?service_id=1561a01e6ab844ba9a6218faa0b648e5&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:35.410867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79819b14-a002-45ad-a0cf-9893eec409e6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:35.415734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-9c0d68d9-ee3c-48cb-820a-e59117a723b6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1fcbe58c6057445982f0d5ab86742d0c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1fcbe58c6057445982f0d5ab86742d0c. Oct 31 14:48:35.415734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:35.415734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:48:35.415734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 14:48:35.415734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:48:35.415734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 14:48:35.415734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:48:35.415734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 14:48:35.415734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:48:35.415734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application conn.query(q) Oct 31 14:48:35.415734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:48:35.415734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:48:35.415734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application result.read() Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 14:48:35.416700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application yield resource Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise self.value Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application session.commit() Oct 31 14:48:35.418214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self.session.flush() Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application compat.raise_( Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 14:48:35.420163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 14:48:35.422317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application conn.query(q) Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application result.read() Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:48:35.424239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [parameters: {'id': '1fcbe58c6057445982f0d5ab86742d0c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:35.426933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:35.427750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:35.429010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:35.429010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 31 14:48:35.429010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 31 14:48:35.429010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:35.429010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:35.429010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 14:48:35.429010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 14:48:35.429010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1fcbe58c6057445982f0d5ab86742d0c. Oct 31 14:48:35.429010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:35.429010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 375/744] 10.222.0.45 () {60 vars in 1140 bytes} [Mon Oct 31 14:48:35 2022] POST /identity/v3/projects => generated 262 bytes in 277 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:35.429010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d68d9-ee3c-48cb-820a-e59117a723b6 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:35.548579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79819b14-a002-45ad-a0cf-9893eec409e6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:35.553982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d68d9-ee3c-48cb-820a-e59117a723b6 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:35.557984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:35.591588 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e3199-d4fa-423a-adf5-5df7880b9203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:35.592610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e3199-d4fa-423a-adf5-5df7880b9203 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.593065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e3199-d4fa-423a-adf5-5df7880b9203 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.593641 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e3199-d4fa-423a-adf5-5df7880b9203 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.594276 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cc8e3-39c2-4dc1-b3c0-570a25cb5ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:35.595401 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cc8e3-39c2-4dc1-b3c0-570a25cb5ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.595743 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cc8e3-39c2-4dc1-b3c0-570a25cb5ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.596078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cc8e3-39c2-4dc1-b3c0-570a25cb5ca2 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.596757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cc8e3-39c2-4dc1-b3c0-570a25cb5ca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:35.599145 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cc8e3-39c2-4dc1-b3c0-570a25cb5ca2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:35.604064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e3199-d4fa-423a-adf5-5df7880b9203 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:35.606110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e3199-d4fa-423a-adf5-5df7880b9203 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:35.609356 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 370/745] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 31 14:48:35 2022] GET /identity/v3/services => generated 1957 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:35.626677 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63231a2d-99e4-4c1c-b5da-c751181dacb2 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.627000 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63231a2d-99e4-4c1c-b5da-c751181dacb2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.627304 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63231a2d-99e4-4c1c-b5da-c751181dacb2 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-581e3199-d4fa-423a-adf5-5df7880b9203 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:35.627810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:35.628667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:35.629620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:35.629620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:35.629620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:35.629620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:35.629620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:35.629620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:35.629620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:35.629620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:35.630052 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 371/746] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:48:35.634560 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 376/747] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:35.636527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980faf4-ab06-4d98-b455-c076fc7da683 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.636876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980faf4-ab06-4d98-b455-c076fc7da683 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.637166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5638-44c2-4ca3-a4f8-8e79145751c8 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.637263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980faf4-ab06-4d98-b455-c076fc7da683 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.637491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5638-44c2-4ca3-a4f8-8e79145751c8 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.637765 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5638-44c2-4ca3-a4f8-8e79145751c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.638900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 372/748] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:35.639644 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980faf4-ab06-4d98-b455-c076fc7da683 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:35.657621 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-02cf5638-44c2-4ca3-a4f8-8e79145751c8 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:35.660278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-02cf5638-44c2-4ca3-a4f8-8e79145751c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:35.697179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:35.742953 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 377/749] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:35 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:35.744949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec00240-bb18-4d9a-944d-5d86b3e5c01c None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.745251 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec00240-bb18-4d9a-944d-5d86b3e5c01c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.745555 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec00240-bb18-4d9a-944d-5d86b3e5c01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.763989 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980faf4-ab06-4d98-b455-c076fc7da683 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:35.771041 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-4ec00240-bb18-4d9a-944d-5d86b3e5c01c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:35.773460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-4ec00240-bb18-4d9a-944d-5d86b3e5c01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:35.812063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a364204-8bfc-4759-99ef-7ff7fd9a0e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:35.812722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a364204-8bfc-4759-99ef-7ff7fd9a0e6d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:35.813072 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a364204-8bfc-4759-99ef-7ff7fd9a0e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:35.814171 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a364204-8bfc-4759-99ef-7ff7fd9a0e6d None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:35.814877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a364204-8bfc-4759-99ef-7ff7fd9a0e6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:35.815147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a364204-8bfc-4759-99ef-7ff7fd9a0e6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:35.816571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a364204-8bfc-4759-99ef-7ff7fd9a0e6d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:35.836313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 373/750] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 31 14:48:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:35.858082 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 378/751] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:35 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:36.032519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a364204-8bfc-4759-99ef-7ff7fd9a0e6d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.126663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec00240-bb18-4d9a-944d-5d86b3e5c01c None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.146880 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a364204-8bfc-4759-99ef-7ff7fd9a0e6d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:36.148633 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:36.158948 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:36.186777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5211abd-a0f3-49d7-ab1a-707140e8c647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:36.187706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5211abd-a0f3-49d7-ab1a-707140e8c647 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:36.187992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5211abd-a0f3-49d7-ab1a-707140e8c647 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:36.188266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5211abd-a0f3-49d7-ab1a-707140e8c647 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:36.188852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5211abd-a0f3-49d7-ab1a-707140e8c647 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:36.190330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5211abd-a0f3-49d7-ab1a-707140e8c647 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d5211abd-a0f3-49d7-ab1a-707140e8c647 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:36.203225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:36.204427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:36.205431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 374/752] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 31 14:48:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:36.210576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5211abd-a0f3-49d7-ab1a-707140e8c647 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.243673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec00240-bb18-4d9a-944d-5d86b3e5c01c None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:36.284603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17185fa-e578-437e-9cca-18e2164fe593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:36.285755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17185fa-e578-437e-9cca-18e2164fe593 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:36.286092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17185fa-e578-437e-9cca-18e2164fe593 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:36.286610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17185fa-e578-437e-9cca-18e2164fe593 None admin] PATH_INFO: `/v3/services/image` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:36.287923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17185fa-e578-437e-9cca-18e2164fe593 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:36.289952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17185fa-e578-437e-9cca-18e2164fe593 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-e17185fa-e578-437e-9cca-18e2164fe593 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:36.307279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:36.308976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:36.310205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 379/753] 10.222.0.45 () {56 vars in 1105 bytes} [Mon Oct 31 14:48:36 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:36.316103 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17185fa-e578-437e-9cca-18e2164fe593 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.346433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5211abd-a0f3-49d7-ab1a-707140e8c647 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:36.390548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ca970-6eb2-488e-bfd9-f8199eed6977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:36.391194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ca970-6eb2-488e-bfd9-f8199eed6977 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:36.391580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ca970-6eb2-488e-bfd9-f8199eed6977 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:36.391943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ca970-6eb2-488e-bfd9-f8199eed6977 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:36.392673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ca970-6eb2-488e-bfd9-f8199eed6977 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:36.393547 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ca970-6eb2-488e-bfd9-f8199eed6977 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:36.395429 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ca970-6eb2-488e-bfd9-f8199eed6977 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:36.402607 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 375/754] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 31 14:48:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:36.407962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ca970-6eb2-488e-bfd9-f8199eed6977 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.440575 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:36.452561 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:36.456262 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17185fa-e578-437e-9cca-18e2164fe593 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:36.493889 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5eaa3-cc84-4f8c-82a0-fbc0839a6a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:36.494653 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5eaa3-cc84-4f8c-82a0-fbc0839a6a92 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:36.495192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5eaa3-cc84-4f8c-82a0-fbc0839a6a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:36.495560 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5eaa3-cc84-4f8c-82a0-fbc0839a6a92 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:36.497098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5eaa3-cc84-4f8c-82a0-fbc0839a6a92 None admin] RBAC: Adding query filter params (name=image) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:36.497526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5eaa3-cc84-4f8c-82a0-fbc0839a6a92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:36.499032 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5eaa3-cc84-4f8c-82a0-fbc0839a6a92 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:36.513328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 380/755] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:36.516624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5eaa3-cc84-4f8c-82a0-fbc0839a6a92 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.533532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ca970-6eb2-488e-bfd9-f8199eed6977 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:36.567850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba6f69-1dce-4be4-b793-943d8ce30b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:36.568739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba6f69-1dce-4be4-b793-943d8ce30b82 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:36.569022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba6f69-1dce-4be4-b793-943d8ce30b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:36.569307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba6f69-1dce-4be4-b793-943d8ce30b82 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:36.569930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba6f69-1dce-4be4-b793-943d8ce30b82 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:36.570226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba6f69-1dce-4be4-b793-943d8ce30b82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:36.571628 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba6f69-1dce-4be4-b793-943d8ce30b82 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:36.577161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 376/756] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 31 14:48:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:36.586309 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba6f69-1dce-4be4-b793-943d8ce30b82 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.652814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5eaa3-cc84-4f8c-82a0-fbc0839a6a92 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:36.699837 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401e0c-4a0f-41e7-bfbd-5a9d927e9f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:36.700595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401e0c-4a0f-41e7-bfbd-5a9d927e9f91 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:36.700871 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401e0c-4a0f-41e7-bfbd-5a9d927e9f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:36.701138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe401e0c-4a0f-41e7-bfbd-5a9d927e9f91 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:36.701805 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe401e0c-4a0f-41e7-bfbd-5a9d927e9f91 None admin] RBAC: Adding query filter params (type=image) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:36.702103 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe401e0c-4a0f-41e7-bfbd-5a9d927e9f91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:36.703964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe401e0c-4a0f-41e7-bfbd-5a9d927e9f91 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:36.706531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba6f69-1dce-4be4-b793-943d8ce30b82 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:36.709840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:36.711271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 381/757] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:36.716632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401e0c-4a0f-41e7-bfbd-5a9d927e9f91 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.740188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:36.747906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d701b-6228-4052-bc44-b0a7d85ea81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:36.748782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d701b-6228-4052-bc44-b0a7d85ea81d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:36.749266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d701b-6228-4052-bc44-b0a7d85ea81d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:36.749795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d701b-6228-4052-bc44-b0a7d85ea81d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:36.750721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d701b-6228-4052-bc44-b0a7d85ea81d None admin] RBAC: Adding query filter params (interface=admin, service_id=ec205c62ac5b4d2293d0897b7fbc9918, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:36.751286 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d701b-6228-4052-bc44-b0a7d85ea81d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:36.752886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d701b-6228-4052-bc44-b0a7d85ea81d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:36.759318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 377/758] 10.222.0.45 () {56 vars in 1249 bytes} [Mon Oct 31 14:48:36 2022] GET /identity/v3/endpoints?service_id=ec205c62ac5b4d2293d0897b7fbc9918&interface=admin®ion_id=RegionOne => generated 193 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:36.769365 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d701b-6228-4052-bc44-b0a7d85ea81d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.827880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe401e0c-4a0f-41e7-bfbd-5a9d927e9f91 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:36.864898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210aa2a-54dd-4731-9465-8c1b56f39eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:36.865941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210aa2a-54dd-4731-9465-8c1b56f39eff None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:36.866215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210aa2a-54dd-4731-9465-8c1b56f39eff None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:36.866480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210aa2a-54dd-4731-9465-8c1b56f39eff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:36.867191 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210aa2a-54dd-4731-9465-8c1b56f39eff None admin] RBAC: Adding query filter params (interface=public, service_id=c3bc644c2850410596ce041ff5f65d3c, region_id=RegionOne) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:36.867493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210aa2a-54dd-4731-9465-8c1b56f39eff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:36.868890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210aa2a-54dd-4731-9465-8c1b56f39eff None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:36.879245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d701b-6228-4052-bc44-b0a7d85ea81d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:36.879964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 382/759] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 31 14:48:36 2022] GET /identity/v3/endpoints?service_id=c3bc644c2850410596ce041ff5f65d3c&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:36.881521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210aa2a-54dd-4731-9465-8c1b56f39eff None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:36.918146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c52171-0f5c-43ce-b1d7-7cee71c7340a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:36.918678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c52171-0f5c-43ce-b1d7-7cee71c7340a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:36.918960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c52171-0f5c-43ce-b1d7-7cee71c7340a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:36.919232 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c52171-0f5c-43ce-b1d7-7cee71c7340a None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:36.919840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c52171-0f5c-43ce-b1d7-7cee71c7340a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:36.921480 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c52171-0f5c-43ce-b1d7-7cee71c7340a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:36.941778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 378/760] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 31 14:48:36 2022] GET /identity/v3/services => generated 1957 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:36.996977 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:37.018575 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210aa2a-54dd-4731-9465-8c1b56f39eff None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:37.060578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8669f63-5edd-4351-89b1-d14d2479089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:37.061195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8669f63-5edd-4351-89b1-d14d2479089d None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:37.061501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8669f63-5edd-4351-89b1-d14d2479089d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:37.061768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8669f63-5edd-4351-89b1-d14d2479089d None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:37.062376 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8669f63-5edd-4351-89b1-d14d2479089d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:37.063760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8669f63-5edd-4351-89b1-d14d2479089d None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:37.072121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 383/761] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 31 14:48:36 2022] GET /identity/v3/services => generated 1957 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:48:37.896057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24500729-42fc-4004-9daf-3a9ef202706b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:37.897438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24500729-42fc-4004-9daf-3a9ef202706b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:37.897438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24500729-42fc-4004-9daf-3a9ef202706b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:37.898619 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 379/762] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:37.904043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4450c-f5a9-4980-bccb-dcc73477bacf None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:37.904930 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4450c-f5a9-4980-bccb-dcc73477bacf None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:37.905432 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4450c-f5a9-4980-bccb-dcc73477bacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:37.924064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f2d4450c-f5a9-4980-bccb-dcc73477bacf None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:37.925658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f2d4450c-f5a9-4980-bccb-dcc73477bacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:38.002508 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 384/763] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:37 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:38.196306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8210b14-bbfa-423b-a48c-c241c61a6caa None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:38.196911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8210b14-bbfa-423b-a48c-c241c61a6caa None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:38.197470 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8210b14-bbfa-423b-a48c-c241c61a6caa None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:38.199371 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 380/764] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:38.205044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c92482-c028-47e8-b77b-58a410a67a89 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:38.205593 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c92482-c028-47e8-b77b-58a410a67a89 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:38.206067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c92482-c028-47e8-b77b-58a410a67a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:38.226019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-44c92482-c028-47e8-b77b-58a410a67a89 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:38.227548 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-44c92482-c028-47e8-b77b-58a410a67a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:38.275099 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8210b14-bbfa-423b-a48c-c241c61a6caa None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:38.299201 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 385/765] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:38 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:38.302904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:38.384286 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8210b14-bbfa-423b-a48c-c241c61a6caa None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:38.418973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbd3e8-0996-4a03-b824-6cd2c59dd076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:38.419593 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbd3e8-0996-4a03-b824-6cd2c59dd076 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:38.419866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbd3e8-0996-4a03-b824-6cd2c59dd076 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:38.420130 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbd3e8-0996-4a03-b824-6cd2c59dd076 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:38.420704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbd3e8-0996-4a03-b824-6cd2c59dd076 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:38.422085 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbd3e8-0996-4a03-b824-6cd2c59dd076 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-6ecbd3e8-0996-4a03-b824-6cd2c59dd076 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:38.431028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:38.431994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:38.432814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 381/766] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:38.439631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c92482-c028-47e8-b77b-58a410a67a89 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:38.444026 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:38.546317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c92482-c028-47e8-b77b-58a410a67a89 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:38.578816 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbd3e8-0996-4a03-b824-6cd2c59dd076 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:38.581043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a69d9-722d-4c05-8f14-fbc67d0febe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:38.581696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a69d9-722d-4c05-8f14-fbc67d0febe1 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:38.581959 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a69d9-722d-4c05-8f14-fbc67d0febe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:38.582221 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a69d9-722d-4c05-8f14-fbc67d0febe1 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:38.582845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a69d9-722d-4c05-8f14-fbc67d0febe1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:38.583139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a69d9-722d-4c05-8f14-fbc67d0febe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:38.584764 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a69d9-722d-4c05-8f14-fbc67d0febe1 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:38.593332 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 386/767] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 31 14:48:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:38.596077 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a69d9-722d-4c05-8f14-fbc67d0febe1 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:38.666470 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:38.689665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:38.701753 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbd3e8-0996-4a03-b824-6cd2c59dd076 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:38.710298 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a69d9-722d-4c05-8f14-fbc67d0febe1 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:38.739919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5940e-c68f-4428-a2f0-ec9f33391ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:38.741179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5940e-c68f-4428-a2f0-ec9f33391ea0 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:38.741492 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5940e-c68f-4428-a2f0-ec9f33391ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:38.741821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5940e-c68f-4428-a2f0-ec9f33391ea0 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:38.742574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5940e-c68f-4428-a2f0-ec9f33391ea0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:38.744098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5940e-c68f-4428-a2f0-ec9f33391ea0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:38.747406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: WARNING keystone.server.flask.common [None req-c5d5940e-c68f-4428-a2f0-ec9f33391ea0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 31 14:48:38.754779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149f2ae-60a5-49b5-924d-c8e347455b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:38.756476 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149f2ae-60a5-49b5-924d-c8e347455b34 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:38.757534 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149f2ae-60a5-49b5-924d-c8e347455b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:38.757821 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149f2ae-60a5-49b5-924d-c8e347455b34 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:38.758462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149f2ae-60a5-49b5-924d-c8e347455b34 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:38.758759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149f2ae-60a5-49b5-924d-c8e347455b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:38.760108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149f2ae-60a5-49b5-924d-c8e347455b34 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:38.765556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 387/768] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Oct 31 14:48:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:38.770979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149f2ae-60a5-49b5-924d-c8e347455b34 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:38.807667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.sql.core [None req-c5d5940e-c68f-4428-a2f0-ec9f33391ea0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 14:48:38.807667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 31 14:48:38.807667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [parameters: {'user_id': 'e16c80c0d4384479b8f781456279d17b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 31 14:48:38.807667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81683) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c5d5940e-c68f-4428-a2f0-ec9f33391ea0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application conn.query(q) Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result.read() Oct 31 14:48:38.817709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:48:38.819340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application yield resource Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise self.value Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application session.commit() Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 14:48:38.820328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.session.flush() Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application compat.raise_( Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 14:48:38.821216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:48:38.822173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application conn.query(q) Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result.read() Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:48:38.825761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e16c80c0d4384479b8f781456279d17b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:38.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 31 14:48:38.830157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 31 14:48:38.832392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 31 14:48:38.832392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 31 14:48:38.832392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 14:48:38.832392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 14:48:38.832392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 31 14:48:38.832392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:38.832392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 382/769] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Oct 31 14:48:38 2022] POST /identity/v3/users => generated 160 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:38.832392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5940e-c68f-4428-a2f0-ec9f33391ea0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:38.900988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149f2ae-60a5-49b5-924d-c8e347455b34 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:38.941123 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:38.942218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5940e-c68f-4428-a2f0-ec9f33391ea0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:38.949993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71561ff-8632-4246-b93b-f68ecd1fd16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:38.951337 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71561ff-8632-4246-b93b-f68ecd1fd16d None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:38.951784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71561ff-8632-4246-b93b-f68ecd1fd16d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:38.955968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71561ff-8632-4246-b93b-f68ecd1fd16d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:38.955968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71561ff-8632-4246-b93b-f68ecd1fd16d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:38.955968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71561ff-8632-4246-b93b-f68ecd1fd16d None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:38.983335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c7071-271a-4ae7-a02b-d0357ca7cc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:38.984022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c7071-271a-4ae7-a02b-d0357ca7cc92 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:38.996177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c7071-271a-4ae7-a02b-d0357ca7cc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:38.996177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c7071-271a-4ae7-a02b-d0357ca7cc92 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:38.996177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c7071-271a-4ae7-a02b-d0357ca7cc92 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:38.996177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c7071-271a-4ae7-a02b-d0357ca7cc92 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-688c7071-271a-4ae7-a02b-d0357ca7cc92 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:48:39.006446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:39.007604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:39.009185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:39.009185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:39.009185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:48:39.009185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:48:39.009185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:48:39.009185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:48:39.009185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:48:39.009185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:48:39.009185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 31 14:48:39.009185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:39.009185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 383/770] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:48:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:39.013116 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c7071-271a-4ae7-a02b-d0357ca7cc92 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:39.024850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:39.085312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 388/771] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:48:39.132699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c7071-271a-4ae7-a02b-d0357ca7cc92 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:39.190923 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af285b5-dc47-4bfc-87a7-f44560b6906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:39.191898 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af285b5-dc47-4bfc-87a7-f44560b6906d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:39.192397 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af285b5-dc47-4bfc-87a7-f44560b6906d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:39.192900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af285b5-dc47-4bfc-87a7-f44560b6906d None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:39.194727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af285b5-dc47-4bfc-87a7-f44560b6906d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:39.195258 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af285b5-dc47-4bfc-87a7-f44560b6906d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:39.196934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af285b5-dc47-4bfc-87a7-f44560b6906d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:39.239024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 384/772] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Oct 31 14:48:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:39.256767 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6cf25-88d3-43e4-9a9a-7d68c60c6bad None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:39.257116 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6cf25-88d3-43e4-9a9a-7d68c60c6bad None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:39.257312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6cf25-88d3-43e4-9a9a-7d68c60c6bad None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:39.259128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 389/773] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:39.265266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefcae7-9c0c-4a45-9833-913c30749b6c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:39.265606 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefcae7-9c0c-4a45-9833-913c30749b6c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:39.265861 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefcae7-9c0c-4a45-9833-913c30749b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:39.289559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-bcefcae7-9c0c-4a45-9833-913c30749b6c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:39.290590 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bcefcae7-9c0c-4a45-9833-913c30749b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:39.343916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8fb2-4417-4249-9e01-3a18c9aae9bc None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:39.343916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8fb2-4417-4249-9e01-3a18c9aae9bc None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:39.344192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce8fb2-4417-4249-9e01-3a18c9aae9bc None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:39.345924 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 390/774] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:39.351663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d9e2a-b2bd-4d72-ba95-8db9583eccf3 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:39.351996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d9e2a-b2bd-4d72-ba95-8db9583eccf3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:39.352204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d9e2a-b2bd-4d72-ba95-8db9583eccf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:39.363616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:39.374970 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-ee7d9e2a-b2bd-4d72-ba95-8db9583eccf3 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:39.381308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ee7d9e2a-b2bd-4d72-ba95-8db9583eccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:39.381439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 385/775] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:39 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:39.457575 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 391/776] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:39 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:39.650474 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefcae7-9c0c-4a45-9833-913c30749b6c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:39.733139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d9e2a-b2bd-4d72-ba95-8db9583eccf3 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:39.756336 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefcae7-9c0c-4a45-9833-913c30749b6c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:39.798193 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2422f-1a45-4528-adfd-aa6ce8aee168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:39.798829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2422f-1a45-4528-adfd-aa6ce8aee168 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:39.799105 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2422f-1a45-4528-adfd-aa6ce8aee168 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:39.799375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2422f-1a45-4528-adfd-aa6ce8aee168 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:39.799958 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2422f-1a45-4528-adfd-aa6ce8aee168 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:39.801338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2422f-1a45-4528-adfd-aa6ce8aee168 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-0dd2422f-1a45-4528-adfd-aa6ce8aee168 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:39.810420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:39.811402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:39.812221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 386/777] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Oct 31 14:48:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:39.817524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2422f-1a45-4528-adfd-aa6ce8aee168 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:39.851387 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d9e2a-b2bd-4d72-ba95-8db9583eccf3 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:39.870671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:39.877425 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:39.888989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951197-b1c1-4557-9645-f8463053a6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:39.889647 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951197-b1c1-4557-9645-f8463053a6de None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:39.889932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951197-b1c1-4557-9645-f8463053a6de None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:39.890178 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8951197-b1c1-4557-9645-f8463053a6de None admin] PATH_INFO: `/v3/services/image` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:39.890862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8951197-b1c1-4557-9645-f8463053a6de None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:39.892987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8951197-b1c1-4557-9645-f8463053a6de None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-f8951197-b1c1-4557-9645-f8463053a6de None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:39.901099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:39.902152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 31 14:48:39.902992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:39.905453 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 392/778] 10.222.0.45 () {56 vars in 1105 bytes} [Mon Oct 31 14:48:39 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:39.908277 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951197-b1c1-4557-9645-f8463053a6de None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:39.925384 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2422f-1a45-4528-adfd-aa6ce8aee168 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:39.963227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34008ee6-cd0e-4ca3-bce5-f3a3de3df7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:39.963897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34008ee6-cd0e-4ca3-bce5-f3a3de3df7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:39.964126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34008ee6-cd0e-4ca3-bce5-f3a3de3df7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:39.964464 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34008ee6-cd0e-4ca3-bce5-f3a3de3df7e3 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:39.965097 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34008ee6-cd0e-4ca3-bce5-f3a3de3df7e3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:39.965442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34008ee6-cd0e-4ca3-bce5-f3a3de3df7e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:39.966808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34008ee6-cd0e-4ca3-bce5-f3a3de3df7e3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:39.975850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 387/779] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 31 14:48:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:39.981971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34008ee6-cd0e-4ca3-bce5-f3a3de3df7e3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:40.019396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8951197-b1c1-4557-9645-f8463053a6de None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:40.055870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eaed3-e0c8-4002-ae11-ad4c8a97a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:40.056470 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eaed3-e0c8-4002-ae11-ad4c8a97a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:40.056742 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eaed3-e0c8-4002-ae11-ad4c8a97a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:40.057007 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eaed3-e0c8-4002-ae11-ad4c8a97a8d8 None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:40.057665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eaed3-e0c8-4002-ae11-ad4c8a97a8d8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:40.057963 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eaed3-e0c8-4002-ae11-ad4c8a97a8d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:40.059326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eaed3-e0c8-4002-ae11-ad4c8a97a8d8 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:40.069445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 393/780] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:40.070737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eaed3-e0c8-4002-ae11-ad4c8a97a8d8 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:40.097456 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34008ee6-cd0e-4ca3-bce5-f3a3de3df7e3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:40.119501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:40.124686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:40.133912 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186f0a6-e788-4309-87a5-e700cec09f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:40.134750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f0a6-e788-4309-87a5-e700cec09f94 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:40.134847 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f0a6-e788-4309-87a5-e700cec09f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:40.135032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f0a6-e788-4309-87a5-e700cec09f94 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:40.135651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186f0a6-e788-4309-87a5-e700cec09f94 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:40.135945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186f0a6-e788-4309-87a5-e700cec09f94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:40.137314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186f0a6-e788-4309-87a5-e700cec09f94 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:40.148369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 388/781] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Oct 31 14:48:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:40.149569 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186f0a6-e788-4309-87a5-e700cec09f94 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:40.184419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eaed3-e0c8-4002-ae11-ad4c8a97a8d8 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:40.221235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d2cb9-7a62-40c4-b519-30e809d4a50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:40.221940 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2cb9-7a62-40c4-b519-30e809d4a50f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:40.222252 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2cb9-7a62-40c4-b519-30e809d4a50f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:40.222560 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2cb9-7a62-40c4-b519-30e809d4a50f None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:40.223238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d2cb9-7a62-40c4-b519-30e809d4a50f None admin] RBAC: Adding query filter params (type=image) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:40.223584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d2cb9-7a62-40c4-b519-30e809d4a50f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:40.225360 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d2cb9-7a62-40c4-b519-30e809d4a50f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:40.231490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 394/782] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:40.236875 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d2cb9-7a62-40c4-b519-30e809d4a50f None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:40.262020 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186f0a6-e788-4309-87a5-e700cec09f94 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:40.297024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddc411-285c-443b-be73-45f7f79247a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:40.297656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddc411-285c-443b-be73-45f7f79247a9 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:40.297934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddc411-285c-443b-be73-45f7f79247a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:40.298204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddc411-285c-443b-be73-45f7f79247a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:40.298857 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddc411-285c-443b-be73-45f7f79247a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:40.300227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddc411-285c-443b-be73-45f7f79247a9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:40.343679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d2cb9-7a62-40c4-b519-30e809d4a50f None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:40.353788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:40.377027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333b125-94a1-47f0-ac30-923a584d6717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:40.377670 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333b125-94a1-47f0-ac30-923a584d6717 None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:40.377945 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333b125-94a1-47f0-ac30-923a584d6717 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:40.378213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333b125-94a1-47f0-ac30-923a584d6717 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:40.378864 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333b125-94a1-47f0-ac30-923a584d6717 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:40.380218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333b125-94a1-47f0-ac30-923a584d6717 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:40.459555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 389/783] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:40.501233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 395/784] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 14:48:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:41.440598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63514352-c1d5-43f7-a443-0a8a9b70d256 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:41.441125 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63514352-c1d5-43f7-a443-0a8a9b70d256 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:41.441125 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63514352-c1d5-43f7-a443-0a8a9b70d256 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:41.442671 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 390/785] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:41.448168 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37c10-e1fa-422e-8f48-99e09280ab3d None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:41.448595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37c10-e1fa-422e-8f48-99e09280ab3d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:41.448857 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d37c10-e1fa-422e-8f48-99e09280ab3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:41.467513 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-90d37c10-e1fa-422e-8f48-99e09280ab3d None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:41.468685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-90d37c10-e1fa-422e-8f48-99e09280ab3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:41.545338 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 396/786] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:41.819552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63514352-c1d5-43f7-a443-0a8a9b70d256 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:41.870845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:41.927024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63514352-c1d5-43f7-a443-0a8a9b70d256 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:41.962387 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799ee11-7226-4adf-8ce9-faed0d47e2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:41.963008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ee11-7226-4adf-8ce9-faed0d47e2ab None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:41.963284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ee11-7226-4adf-8ce9-faed0d47e2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:41.963553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ee11-7226-4adf-8ce9-faed0d47e2ab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:41.982722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799ee11-7226-4adf-8ce9-faed0d47e2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1799ee11-7226-4adf-8ce9-faed0d47e2ab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:48:41.987863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:41.988782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:41.989665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:41.989665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:41.989665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:41.989665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:41.989665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:48:41.989665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:48:41.989665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:48:41.989665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:48:41.989665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:48:41.989665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:48:41.989665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 14:48:41.989665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:41.991917 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 391/787] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Oct 31 14:48:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:41.997953 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d37c10-e1fa-422e-8f48-99e09280ab3d None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:42.090313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:42.099251 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d37c10-e1fa-422e-8f48-99e09280ab3d None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:42.133919 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a801b09-f97d-4c5e-bbb5-98476653a1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:42.134501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801b09-f97d-4c5e-bbb5-98476653a1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.134822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801b09-f97d-4c5e-bbb5-98476653a1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.135117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801b09-f97d-4c5e-bbb5-98476653a1f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.135830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a801b09-f97d-4c5e-bbb5-98476653a1f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:42.136130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a801b09-f97d-4c5e-bbb5-98476653a1f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:42.137512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a801b09-f97d-4c5e-bbb5-98476653a1f8 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:42.150122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 397/788] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Oct 31 14:48:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:42.151537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799ee11-7226-4adf-8ce9-faed0d47e2ab None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:42.257185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799ee11-7226-4adf-8ce9-faed0d47e2ab None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:42.259579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:42.292738 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97888b60-ac5d-4d4f-aeac-0e4f93b2daee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:42.293407 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97888b60-ac5d-4d4f-aeac-0e4f93b2daee None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.293690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97888b60-ac5d-4d4f-aeac-0e4f93b2daee None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.293964 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97888b60-ac5d-4d4f-aeac-0e4f93b2daee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.306402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97888b60-ac5d-4d4f-aeac-0e4f93b2daee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:42.307986 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97888b60-ac5d-4d4f-aeac-0e4f93b2daee None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-97888b60-ac5d-4d4f-aeac-0e4f93b2daee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:42.323486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:42.324444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:42.325784 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:42.325784 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:42.325784 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:42.329680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 392/789] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:42.330465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a801b09-f97d-4c5e-bbb5-98476653a1f8 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:42.438645 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a801b09-f97d-4c5e-bbb5-98476653a1f8 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:42.473938 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507be39-3d18-4936-b45c-c7dbd14b8e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:42.475727 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507be39-3d18-4936-b45c-c7dbd14b8e39 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.475727 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507be39-3d18-4936-b45c-c7dbd14b8e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.475727 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507be39-3d18-4936-b45c-c7dbd14b8e39 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.476361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507be39-3d18-4936-b45c-c7dbd14b8e39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:42.476656 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507be39-3d18-4936-b45c-c7dbd14b8e39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:42.478106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507be39-3d18-4936-b45c-c7dbd14b8e39 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:42.491160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 398/790] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:42.496759 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97888b60-ac5d-4d4f-aeac-0e4f93b2daee None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:42.610977 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97888b60-ac5d-4d4f-aeac-0e4f93b2daee None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:42.649066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd5685-1dc4-4ce3-9bb1-54e2e058dbdc None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.649256 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0cd31-7e8d-44cd-a4ab-ca27e25fd29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:42.649418 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd5685-1dc4-4ce3-9bb1-54e2e058dbdc None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.649667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd5685-1dc4-4ce3-9bb1-54e2e058dbdc None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.649876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0cd31-7e8d-44cd-a4ab-ca27e25fd29b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.650156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0cd31-7e8d-44cd-a4ab-ca27e25fd29b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.650430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0cd31-7e8d-44cd-a4ab-ca27e25fd29b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.650952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 399/791] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:48:42.656110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f88fd-a29a-4da8-abbc-a7493694f911 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.656384 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f88fd-a29a-4da8-abbc-a7493694f911 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.656652 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f88fd-a29a-4da8-abbc-a7493694f911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.659799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0cd31-7e8d-44cd-a4ab-ca27e25fd29b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:42.661543 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0cd31-7e8d-44cd-a4ab-ca27e25fd29b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:42.674636 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-332f88fd-a29a-4da8-abbc-a7493694f911 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:42.675803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-332f88fd-a29a-4da8-abbc-a7493694f911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-67a0cd31-7e8d-44cd-a4ab-ca27e25fd29b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:48:42.676166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:42.677079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:42.679238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:42.679238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:42.679238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:48:42.679238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:48:42.679238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:48:42.679238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:48:42.679238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:48:42.679238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:48:42.679238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 14:48:42.679238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:42.679781 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 393/792] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 31 14:48:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:42.685363 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0cd31-7e8d-44cd-a4ab-ca27e25fd29b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:42.689020 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:42.705631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:42.748093 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 400/793] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:42.749248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a123d52-8a5d-4347-9e29-19c0ed6b97d3 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.749573 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a123d52-8a5d-4347-9e29-19c0ed6b97d3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.749827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a123d52-8a5d-4347-9e29-19c0ed6b97d3 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.751125 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 401/794] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:42.756447 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861ec5c-7cff-4536-8856-d142f2c04f71 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.756744 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861ec5c-7cff-4536-8856-d142f2c04f71 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.756981 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861ec5c-7cff-4536-8856-d142f2c04f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.774579 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f861ec5c-7cff-4536-8856-d142f2c04f71 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:42.775745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f861ec5c-7cff-4536-8856-d142f2c04f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:42.793509 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0cd31-7e8d-44cd-a4ab-ca27e25fd29b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:42.831623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc884ff-747b-4c4d-9b29-8eac392dacdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:42.832224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc884ff-747b-4c4d-9b29-8eac392dacdd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:42.832952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc884ff-747b-4c4d-9b29-8eac392dacdd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:42.833237 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc884ff-747b-4c4d-9b29-8eac392dacdd None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:42.834324 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc884ff-747b-4c4d-9b29-8eac392dacdd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:42.834819 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc884ff-747b-4c4d-9b29-8eac392dacdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:42.836248 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc884ff-747b-4c4d-9b29-8eac392dacdd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:42.846658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 402/795] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:42.859814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 394/796] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 31 14:48:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:42.861244 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861ec5c-7cff-4536-8856-d142f2c04f71 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:42.936971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:42.961126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861ec5c-7cff-4536-8856-d142f2c04f71 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.003644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dec21-db7e-4b22-8d4a-60f563cf7122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.004270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dec21-db7e-4b22-8d4a-60f563cf7122 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.004541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dec21-db7e-4b22-8d4a-60f563cf7122 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.004805 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dec21-db7e-4b22-8d4a-60f563cf7122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.015078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dec21-db7e-4b22-8d4a-60f563cf7122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.016508 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dec21-db7e-4b22-8d4a-60f563cf7122 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:43.025153 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc884ff-747b-4c4d-9b29-8eac392dacdd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-1f5dec21-db7e-4b22-8d4a-60f563cf7122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:43.031813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:43.032724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:43.033685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:43.033685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:43.033685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:43.040452 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 403/797] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:43.041480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dec21-db7e-4b22-8d4a-60f563cf7122 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:43.110479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:43.137119 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc884ff-747b-4c4d-9b29-8eac392dacdd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.147916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dec21-db7e-4b22-8d4a-60f563cf7122 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.173532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddc0aa-c8c1-45ba-b325-bba76dd24041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.173713 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:43.174156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddc0aa-c8c1-45ba-b325-bba76dd24041 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.174432 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddc0aa-c8c1-45ba-b325-bba76dd24041 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.174700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddc0aa-c8c1-45ba-b325-bba76dd24041 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.175814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddc0aa-c8c1-45ba-b325-bba76dd24041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.177228 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddc0aa-c8c1-45ba-b325-bba76dd24041 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:43.179402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 395/798] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:43.180143 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddc0aa-c8c1-45ba-b325-bba76dd24041 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:43.183026 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618594d-ca8e-4da5-9ffe-36d2131f2236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.189182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618594d-ca8e-4da5-9ffe-36d2131f2236 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.189182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618594d-ca8e-4da5-9ffe-36d2131f2236 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.189182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618594d-ca8e-4da5-9ffe-36d2131f2236 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.189182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618594d-ca8e-4da5-9ffe-36d2131f2236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:43.189182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618594d-ca8e-4da5-9ffe-36d2131f2236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.189182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618594d-ca8e-4da5-9ffe-36d2131f2236 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:43.198870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 404/799] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:43.199648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618594d-ca8e-4da5-9ffe-36d2131f2236 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:43.279192 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddc0aa-c8c1-45ba-b325-bba76dd24041 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.299882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618594d-ca8e-4da5-9ffe-36d2131f2236 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.312063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9b89b-8e6d-4b42-ae92-2b81becb46f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.312657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9b89b-8e6d-4b42-ae92-2b81becb46f8 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.312931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9b89b-8e6d-4b42-ae92-2b81becb46f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.313202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9b89b-8e6d-4b42-ae92-2b81becb46f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.313885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9b89b-8e6d-4b42-ae92-2b81becb46f8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.315240 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9b89b-8e6d-4b42-ae92-2b81becb46f8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:43.336290 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64635692-0d88-4a57-9981-a0a16b56a8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.336886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64635692-0d88-4a57-9981-a0a16b56a8a5 None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.337163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64635692-0d88-4a57-9981-a0a16b56a8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.337466 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64635692-0d88-4a57-9981-a0a16b56a8a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.338102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64635692-0d88-4a57-9981-a0a16b56a8a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.339520 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64635692-0d88-4a57-9981-a0a16b56a8a5 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:43.354972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.sql.core [None req-5cc9b89b-8e6d-4b42-ae92-2b81becb46f8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 14:48:43.354972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 14:48:43.354972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [parameters: {'id': 'd8ea7c226b3442dca2073a31c9de3577', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 14:48:43.354972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81683) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5cc9b89b-8e6d-4b42-ae92-2b81becb46f8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application conn.query(q) Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:48:43.363196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result.read() Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 31 14:48:43.366479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application yield resource Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application next(self.gen) Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.session.rollback() Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.force_reraise() Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise self.value Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application session.commit() Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 31 14:48:43.367453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._prepare_impl() Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.session.flush() Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._flush(objects) Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application compat.raise_( Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application flush_context.execute() Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rec.execute(self) Oct 31 14:48:43.368361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 14:48:43.369238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result = self._query(query) Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application conn.query(q) Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application result.read() Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 31 14:48:43.370042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [parameters: {'id': 'd8ea7c226b3442dca2073a31c9de3577', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 31 14:48:43.371150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:43.372152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 396/800] 10.222.0.45 () {60 vars in 1137 bytes} [Mon Oct 31 14:48:43 2022] POST /identity/v3/domains => generated 190 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:43.373267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9b89b-8e6d-4b42-ae92-2b81becb46f8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:43.374405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:43.461599 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9b89b-8e6d-4b42-ae92-2b81becb46f8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.466382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 405/801] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:48:43 2022] POST /identity/v3/projects => generated 311 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:43.467284 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64635692-0d88-4a57-9981-a0a16b56a8a5 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:43.498404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f8912-b4c4-41f0-9f5d-6ea9f9fb1f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.499151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8912-b4c4-41f0-9f5d-6ea9f9fb1f67 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.499499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8912-b4c4-41f0-9f5d-6ea9f9fb1f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.499774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8912-b4c4-41f0-9f5d-6ea9f9fb1f67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.509200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f8912-b4c4-41f0-9f5d-6ea9f9fb1f67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.510664 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f8912-b4c4-41f0-9f5d-6ea9f9fb1f67 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:43.516047 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-502f8912-b4c4-41f0-9f5d-6ea9f9fb1f67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:43.523257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:43.524420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:43.525476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:43.525476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:43.525476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:43.525476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:43.525476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:43.525476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:43.525476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:43.525476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:43.525476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 397/802] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:43.531078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f8912-b4c4-41f0-9f5d-6ea9f9fb1f67 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:43.591301 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64635692-0d88-4a57-9981-a0a16b56a8a5 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.607253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:43.635221 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6a04f-9ded-402e-8a87-b3374b9b4309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.636323 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6a04f-9ded-402e-8a87-b3374b9b4309 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.636663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6a04f-9ded-402e-8a87-b3374b9b4309 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.637003 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6a04f-9ded-402e-8a87-b3374b9b4309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.647585 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f8912-b4c4-41f0-9f5d-6ea9f9fb1f67 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.652126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6a04f-9ded-402e-8a87-b3374b9b4309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.653644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6a04f-9ded-402e-8a87-b3374b9b4309 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-38e6a04f-9ded-402e-8a87-b3374b9b4309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:43.670882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:43.672015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:43.673121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:43.673121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:43.673121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:43.674533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 406/803] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:43.681065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6a04f-9ded-402e-8a87-b3374b9b4309 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:43.685501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dca6e6-275b-413a-a127-d482f323ffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.686108 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dca6e6-275b-413a-a127-d482f323ffb7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.686395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dca6e6-275b-413a-a127-d482f323ffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.687344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dca6e6-275b-413a-a127-d482f323ffb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.687344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dca6e6-275b-413a-a127-d482f323ffb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:43.687625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dca6e6-275b-413a-a127-d482f323ffb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.689038 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dca6e6-275b-413a-a127-d482f323ffb7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:43.703179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 398/804] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:48:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:43.709761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dca6e6-275b-413a-a127-d482f323ffb7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:43.780971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:43.796670 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6a04f-9ded-402e-8a87-b3374b9b4309 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.821213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dca6e6-275b-413a-a127-d482f323ffb7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:43.827583 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e328-4917-4519-ace9-7fe2c53b1b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.828307 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e328-4917-4519-ace9-7fe2c53b1b52 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.828678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e328-4917-4519-ace9-7fe2c53b1b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.829042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e328-4917-4519-ace9-7fe2c53b1b52 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.829810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08e328-4917-4519-ace9-7fe2c53b1b52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:43.830202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08e328-4917-4519-ace9-7fe2c53b1b52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.831692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08e328-4917-4519-ace9-7fe2c53b1b52 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:43.844570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 407/805] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:43.849236 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:43.859210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a064d-bd9c-496c-bb22-1faed6267fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:43.859952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a064d-bd9c-496c-bb22-1faed6267fba None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:43.860229 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a064d-bd9c-496c-bb22-1faed6267fba None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:43.860498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a064d-bd9c-496c-bb22-1faed6267fba None admin] PATH_INFO: `/v3/projects/b82a0373e3b649f3a023efd8db204123/users/9ec30e419d6f4fddb05c4bb08f2ce3f0/roles/0b9c6ffe14ae4031b903136ad93d0474` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:43.862893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a064d-bd9c-496c-bb22-1faed6267fba None admin] RBAC: Authorizing `identity:create_grant(project_id=b82a0373e3b649f3a023efd8db204123, user_id=9ec30e419d6f4fddb05c4bb08f2ce3f0, role_id=0b9c6ffe14ae4031b903136ad93d0474)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:43.864367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a064d-bd9c-496c-bb22-1faed6267fba None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:44.029856 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 399/806] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:48:43 2022] PUT /identity/v3/projects/b82a0373e3b649f3a023efd8db204123/users/9ec30e419d6f4fddb05c4bb08f2ce3f0/roles/0b9c6ffe14ae4031b903136ad93d0474 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:48:45.656551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f66773-ff81-4688-9d26-49e6dfe284c3 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:45.657087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f66773-ff81-4688-9d26-49e6dfe284c3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:45.657087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f66773-ff81-4688-9d26-49e6dfe284c3 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:45.658436 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 408/807] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:45.663962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae3aa3-8d52-4d20-9716-12f517829da0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:45.664362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae3aa3-8d52-4d20-9716-12f517829da0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:45.664573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae3aa3-8d52-4d20-9716-12f517829da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:45.682779 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0dae3aa3-8d52-4d20-9716-12f517829da0 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:45.683940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0dae3aa3-8d52-4d20-9716-12f517829da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:45.749170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 400/808] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:46.016519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f66773-ff81-4688-9d26-49e6dfe284c3 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:46.122856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f66773-ff81-4688-9d26-49e6dfe284c3 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:46.156826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9bf3e-52dd-4b51-b787-a63e4fbbcc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:46.157477 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9bf3e-52dd-4b51-b787-a63e4fbbcc02 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:46.157750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9bf3e-52dd-4b51-b787-a63e4fbbcc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:46.158014 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9bf3e-52dd-4b51-b787-a63e4fbbcc02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:46.159092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9bf3e-52dd-4b51-b787-a63e4fbbcc02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:46.160530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9bf3e-52dd-4b51-b787-a63e4fbbcc02 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:46.162182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 409/809] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:46.167993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae3aa3-8d52-4d20-9716-12f517829da0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:46.175999 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda9845-0952-4904-a14e-fd1824148575 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:46.176275 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda9845-0952-4904-a14e-fd1824148575 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:46.176541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda9845-0952-4904-a14e-fd1824148575 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:46.178570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 410/810] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 14:48:46.183390 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c352d2-d19e-47a4-887e-54078954fcbc None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:46.183665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c352d2-d19e-47a4-887e-54078954fcbc None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:46.183932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c352d2-d19e-47a4-887e-54078954fcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:46.202204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-20c352d2-d19e-47a4-887e-54078954fcbc None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:46.203398 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-20c352d2-d19e-47a4-887e-54078954fcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:46.216448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:46.267366 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae3aa3-8d52-4d20-9716-12f517829da0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:46.269569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 411/811] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 31 14:48:46.285179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:46.302326 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb544a64-3a44-4d8b-ae83-467d8eabd46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:46.303847 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544a64-3a44-4d8b-ae83-467d8eabd46f None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:46.304120 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544a64-3a44-4d8b-ae83-467d8eabd46f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:46.304382 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544a64-3a44-4d8b-ae83-467d8eabd46f None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:46.305028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb544a64-3a44-4d8b-ae83-467d8eabd46f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:46.306462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb544a64-3a44-4d8b-ae83-467d8eabd46f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:46.452559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 401/812] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:48:46 2022] POST /identity/v3/users => generated 285 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:46.544278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c352d2-d19e-47a4-887e-54078954fcbc None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:46.649166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c352d2-d19e-47a4-887e-54078954fcbc None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:46.684714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3805d1a-d3e6-41b8-844f-782bc9ec410d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:46.685401 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3805d1a-d3e6-41b8-844f-782bc9ec410d None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:46.685623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3805d1a-d3e6-41b8-844f-782bc9ec410d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:46.685887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3805d1a-d3e6-41b8-844f-782bc9ec410d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:46.695965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3805d1a-d3e6-41b8-844f-782bc9ec410d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-b3805d1a-d3e6-41b8-844f-782bc9ec410d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:48:46.700692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:46.701787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:46.702815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:46.702815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:46.702815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:46.702815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:46.702815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:48:46.702815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:48:46.702815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:48:46.702815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:48:46.702815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:48:46.702815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:48:46.702815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 31 14:48:46.702815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:46.702815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 412/813] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Oct 31 14:48:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:46.707950 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb544a64-3a44-4d8b-ae83-467d8eabd46f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:46.805347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb544a64-3a44-4d8b-ae83-467d8eabd46f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:46.838312 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f91647-30fc-429f-85e4-880c282f3cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:46.840273 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f91647-30fc-429f-85e4-880c282f3cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:46.840273 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f91647-30fc-429f-85e4-880c282f3cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:46.840273 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f91647-30fc-429f-85e4-880c282f3cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:46.840273 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f91647-30fc-429f-85e4-880c282f3cf5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:46.840563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f91647-30fc-429f-85e4-880c282f3cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:46.841699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f91647-30fc-429f-85e4-880c282f3cf5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:46.854615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 402/814] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Oct 31 14:48:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:46.855844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3805d1a-d3e6-41b8-844f-782bc9ec410d None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:46.867965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:46.956707 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3805d1a-d3e6-41b8-844f-782bc9ec410d None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:46.991225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48486fd-d795-412e-b698-0119ce71aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:46.991846 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48486fd-d795-412e-b698-0119ce71aa6a None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:46.992119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48486fd-d795-412e-b698-0119ce71aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:46.992385 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48486fd-d795-412e-b698-0119ce71aa6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:47.002107 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48486fd-d795-412e-b698-0119ce71aa6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:47.003529 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48486fd-d795-412e-b698-0119ce71aa6a None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-e48486fd-d795-412e-b698-0119ce71aa6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:47.018530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:47.019587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:47.020465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:47.020465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:47.020465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:47.020465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 413/815] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:47.025535 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f91647-30fc-429f-85e4-880c282f3cf5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:47.060572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:47.125037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f91647-30fc-429f-85e4-880c282f3cf5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:47.159932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb9a9-1f89-4c1b-84f7-215afc49645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:47.160529 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb9a9-1f89-4c1b-84f7-215afc49645d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:47.160809 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb9a9-1f89-4c1b-84f7-215afc49645d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:47.161083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb9a9-1f89-4c1b-84f7-215afc49645d None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:47.161777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffb9a9-1f89-4c1b-84f7-215afc49645d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:47.162540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffb9a9-1f89-4c1b-84f7-215afc49645d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:47.163898 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffb9a9-1f89-4c1b-84f7-215afc49645d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:47.175494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 403/816] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:47.181725 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48486fd-d795-412e-b698-0119ce71aa6a None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:47.241371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:47.281572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48486fd-d795-412e-b698-0119ce71aa6a None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:47.314900 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca3161-0b30-4cdc-b482-6f3f0bccbccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:47.315512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca3161-0b30-4cdc-b482-6f3f0bccbccb None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:47.315789 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca3161-0b30-4cdc-b482-6f3f0bccbccb None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:47.316053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca3161-0b30-4cdc-b482-6f3f0bccbccb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:47.323755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca3161-0b30-4cdc-b482-6f3f0bccbccb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:47.325250 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca3161-0b30-4cdc-b482-6f3f0bccbccb None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-5aca3161-0b30-4cdc-b482-6f3f0bccbccb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:48:47.336377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:47.337343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:47.338302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:47.338302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:47.338302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:48:47.338302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:48:47.338302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:48:47.338302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:48:47.338302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:48:47.338302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:48:47.338302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 31 14:48:47.338302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:47.338302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 414/817] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Oct 31 14:48:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:47.343216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb9a9-1f89-4c1b-84f7-215afc49645d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:47.440376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:47.447556 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb9a9-1f89-4c1b-84f7-215afc49645d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:47.481114 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47143808-de44-41a3-bdb6-4e924ef74805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:47.481741 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47143808-de44-41a3-bdb6-4e924ef74805 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:47.482019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47143808-de44-41a3-bdb6-4e924ef74805 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:47.482293 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47143808-de44-41a3-bdb6-4e924ef74805 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:47.483120 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47143808-de44-41a3-bdb6-4e924ef74805 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:47.483423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47143808-de44-41a3-bdb6-4e924ef74805 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:47.484839 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47143808-de44-41a3-bdb6-4e924ef74805 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:47.501927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 404/818] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Oct 31 14:48:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:47.508615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca3161-0b30-4cdc-b482-6f3f0bccbccb None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:47.604663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca3161-0b30-4cdc-b482-6f3f0bccbccb None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:47.623903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:47.637685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a367390-9b8f-41e2-b558-697eea438832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:47.638278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a367390-9b8f-41e2-b558-697eea438832 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:47.642674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a367390-9b8f-41e2-b558-697eea438832 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:47.642674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a367390-9b8f-41e2-b558-697eea438832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:47.706044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a367390-9b8f-41e2-b558-697eea438832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:47.707474 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a367390-9b8f-41e2-b558-697eea438832 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:47.804522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 415/819] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:48:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 14:48:47.810251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47143808-de44-41a3-bdb6-4e924ef74805 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:47.907942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47143808-de44-41a3-bdb6-4e924ef74805 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:47.940406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611227fb-f042-43ab-9489-4e16ceb281ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:47.941018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611227fb-f042-43ab-9489-4e16ceb281ce None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:47.941316 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611227fb-f042-43ab-9489-4e16ceb281ce None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:47.941583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611227fb-f042-43ab-9489-4e16ceb281ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:47.951893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611227fb-f042-43ab-9489-4e16ceb281ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:47.953336 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611227fb-f042-43ab-9489-4e16ceb281ce None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-611227fb-f042-43ab-9489-4e16ceb281ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:48:47.967658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:47.973573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:48:47.975073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:48:47.975073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:48:47.975073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:47.975073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 405/820] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:47.976237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a367390-9b8f-41e2-b558-697eea438832 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:47.998090 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:48.074145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a367390-9b8f-41e2-b558-697eea438832 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:48.108633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9754eb1-1328-47b8-9c9f-c63d6b84140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:48.109232 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754eb1-1328-47b8-9c9f-c63d6b84140a None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:48.109551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754eb1-1328-47b8-9c9f-c63d6b84140a None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:48.109815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754eb1-1328-47b8-9c9f-c63d6b84140a None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:48.110447 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9754eb1-1328-47b8-9c9f-c63d6b84140a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:48.110742 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9754eb1-1328-47b8-9c9f-c63d6b84140a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:48.112100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9754eb1-1328-47b8-9c9f-c63d6b84140a None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:48.123417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 416/821] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:48:48.129108 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611227fb-f042-43ab-9489-4e16ceb281ce None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:48.133510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:48.228500 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611227fb-f042-43ab-9489-4e16ceb281ce None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:48.260890 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64a8c7-e4e6-4d72-b455-071011992670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:48.261538 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64a8c7-e4e6-4d72-b455-071011992670 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:48.261814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64a8c7-e4e6-4d72-b455-071011992670 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:48.262083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64a8c7-e4e6-4d72-b455-071011992670 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:48.268478 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64a8c7-e4e6-4d72-b455-071011992670 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:48.269936 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64a8c7-e4e6-4d72-b455-071011992670 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-de64a8c7-e4e6-4d72-b455-071011992670 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:48:48.281731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:48.282583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:48.284018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:48:48.284018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:48:48.284018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:48:48.284018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:48:48.284018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:48:48.284018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:48:48.284018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:48:48.284018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:48.284018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 406/822] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:48:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:48:48.288882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9754eb1-1328-47b8-9c9f-c63d6b84140a None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:48.368818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:48.387896 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9754eb1-1328-47b8-9c9f-c63d6b84140a None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:48.421113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4a0f3-e7ec-49a0-a519-6fe5ee6175c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:48.421733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4a0f3-e7ec-49a0-a519-6fe5ee6175c8 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:48.422006 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4a0f3-e7ec-49a0-a519-6fe5ee6175c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:48.422272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4a0f3-e7ec-49a0-a519-6fe5ee6175c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:48.422950 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4a0f3-e7ec-49a0-a519-6fe5ee6175c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:48.423248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4a0f3-e7ec-49a0-a519-6fe5ee6175c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:48.424655 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4a0f3-e7ec-49a0-a519-6fe5ee6175c8 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:48.436971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 417/823] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:48:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:48.442992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64a8c7-e4e6-4d72-b455-071011992670 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:48.503662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:48.540148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64a8c7-e4e6-4d72-b455-071011992670 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:48.573456 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85b941-a098-4d8a-b0bb-b10133a569f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:48.574077 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85b941-a098-4d8a-b0bb-b10133a569f5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:48.574355 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85b941-a098-4d8a-b0bb-b10133a569f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:48.574625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85b941-a098-4d8a-b0bb-b10133a569f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:48.575357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85b941-a098-4d8a-b0bb-b10133a569f5 None admin] RBAC: Adding query filter params (role.id=0b9c6ffe14ae4031b903136ad93d0474, scope.project.id=b82a0373e3b649f3a023efd8db204123, user.id=9ec30e419d6f4fddb05c4bb08f2ce3f0) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:48.575662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85b941-a098-4d8a-b0bb-b10133a569f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:48.577111 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85b941-a098-4d8a-b0bb-b10133a569f5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:48.584566 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 407/824] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:48:48 2022] GET /identity/v3/role_assignments?user.id=9ec30e419d6f4fddb05c4bb08f2ce3f0&scope.project.id=b82a0373e3b649f3a023efd8db204123&role.id=0b9c6ffe14ae4031b903136ad93d0474 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:48.695291 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7a8a-d7b2-4f0f-b419-cdf3cfe0175a None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:48.695598 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7a8a-d7b2-4f0f-b419-cdf3cfe0175a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:48.695869 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7a8a-d7b2-4f0f-b419-cdf3cfe0175a None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:48.697226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 418/825] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:48.702999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927adbaf-4b1d-4a21-9553-d9bf12ed525e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:48.703283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927adbaf-4b1d-4a21-9553-d9bf12ed525e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:48.703559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927adbaf-4b1d-4a21-9553-d9bf12ed525e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:48.722984 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-927adbaf-4b1d-4a21-9553-d9bf12ed525e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:48.724209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-927adbaf-4b1d-4a21-9553-d9bf12ed525e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:48.795589 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 408/826] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:49.065309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7a8a-d7b2-4f0f-b419-cdf3cfe0175a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:49.170420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7a8a-d7b2-4f0f-b419-cdf3cfe0175a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:49.204929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f1c78-2b16-41dd-9d85-4fe96cc0b270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:49.205585 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f1c78-2b16-41dd-9d85-4fe96cc0b270 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:49.205864 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f1c78-2b16-41dd-9d85-4fe96cc0b270 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:49.206135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f1c78-2b16-41dd-9d85-4fe96cc0b270 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:49.215041 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:49.218308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f1c78-2b16-41dd-9d85-4fe96cc0b270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-3f2f1c78-2b16-41dd-9d85-4fe96cc0b270 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:48:49.223509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:49.225730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:49.226823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:49.226823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:49.226823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:49.226823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:49.226823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:48:49.226823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:48:49.226823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:48:49.226823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:48:49.226823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:48:49.226823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:48:49.226823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:48:49.226823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:48:49.226823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 419/827] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:48:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:49.232472 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927adbaf-4b1d-4a21-9553-d9bf12ed525e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:49.292757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:49.334871 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927adbaf-4b1d-4a21-9553-d9bf12ed525e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:49.368969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffe238-7e3e-4c57-a393-ff2ddcda9d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:49.369636 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffe238-7e3e-4c57-a393-ff2ddcda9d49 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:49.369909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffe238-7e3e-4c57-a393-ff2ddcda9d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:49.370173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffe238-7e3e-4c57-a393-ff2ddcda9d49 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:49.370827 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffe238-7e3e-4c57-a393-ff2ddcda9d49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:49.371122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffe238-7e3e-4c57-a393-ff2ddcda9d49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:49.372465 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffe238-7e3e-4c57-a393-ff2ddcda9d49 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:49.382131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 409/828] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:48:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:49.388158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f1c78-2b16-41dd-9d85-4fe96cc0b270 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:49.491347 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f1c78-2b16-41dd-9d85-4fe96cc0b270 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:49.523803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0ee2d-f2b8-477d-acf4-683b22591fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:49.524413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0ee2d-f2b8-477d-acf4-683b22591fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:49.524686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0ee2d-f2b8-477d-acf4-683b22591fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:49.524951 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0ee2d-f2b8-477d-acf4-683b22591fd4 None admin] PATH_INFO: `/v3/users/b83f1c611e5d434b9af0204ce553c48b` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:49.538478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0ee2d-f2b8-477d-acf4-683b22591fd4 None admin] RBAC: Authorizing `identity:get_user(user_id=b83f1c611e5d434b9af0204ce553c48b)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:49.539904 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0ee2d-f2b8-477d-acf4-683b22591fd4 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:49.541520 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 420/829] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:48:49 2022] GET /identity/v3/users/b83f1c611e5d434b9af0204ce553c48b => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:49.547257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffe238-7e3e-4c57-a393-ff2ddcda9d49 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:49.643278 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffe238-7e3e-4c57-a393-ff2ddcda9d49 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:49.662647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:49.675542 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690d545-4197-4b58-b958-a80d35da45a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:49.676150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690d545-4197-4b58-b958-a80d35da45a8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:49.676425 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690d545-4197-4b58-b958-a80d35da45a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:49.676692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690d545-4197-4b58-b958-a80d35da45a8 None admin] PATH_INFO: `/v3/projects/5847f4001398433abc4f485f2b821225` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:49.678573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690d545-4197-4b58-b958-a80d35da45a8 None admin] RBAC: Authorizing `identity:get_project(project_id=5847f4001398433abc4f485f2b821225)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:49.679982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690d545-4197-4b58-b958-a80d35da45a8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:49.681582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 410/830] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:48:49 2022] GET /identity/v3/projects/5847f4001398433abc4f485f2b821225 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:49.687450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0ee2d-f2b8-477d-acf4-683b22591fd4 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:49.744553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:49.783450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0ee2d-f2b8-477d-acf4-683b22591fd4 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:49.816969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5551c-cb92-4d9c-b301-d160ae1a2a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:49.817625 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5551c-cb92-4d9c-b301-d160ae1a2a23 None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:49.817895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5551c-cb92-4d9c-b301-d160ae1a2a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:49.818286 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5551c-cb92-4d9c-b301-d160ae1a2a23 None admin] PATH_INFO: `/v3/projects/5847f4001398433abc4f485f2b821225/users/b83f1c611e5d434b9af0204ce553c48b/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:49.820139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5551c-cb92-4d9c-b301-d160ae1a2a23 None admin] RBAC: Authorizing `identity:create_grant(project_id=5847f4001398433abc4f485f2b821225, user_id=b83f1c611e5d434b9af0204ce553c48b, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:49.821571 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5551c-cb92-4d9c-b301-d160ae1a2a23 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:49.904097 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 421/831] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:48:49 2022] PUT /identity/v3/projects/5847f4001398433abc4f485f2b821225/users/b83f1c611e5d434b9af0204ce553c48b/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:48:52.001679 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8a82f-20ca-47fa-a15c-f0b5fb5b1fd1 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:52.002102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8a82f-20ca-47fa-a15c-f0b5fb5b1fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:52.002210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8a82f-20ca-47fa-a15c-f0b5fb5b1fd1 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:52.003543 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 411/832] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:52.008851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f0f99-f71e-453e-9d3d-a18678209d64 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:52.009320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f0f99-f71e-453e-9d3d-a18678209d64 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:52.009413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f0f99-f71e-453e-9d3d-a18678209d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:52.027118 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-093f0f99-f71e-453e-9d3d-a18678209d64 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:52.028288 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-093f0f99-f71e-453e-9d3d-a18678209d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:52.093584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 422/833] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:52.366090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8a82f-20ca-47fa-a15c-f0b5fb5b1fd1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:52.467046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8a82f-20ca-47fa-a15c-f0b5fb5b1fd1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:52.499835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2afccb-3bca-4255-90e2-1b4087e74830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:52.500446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2afccb-3bca-4255-90e2-1b4087e74830 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:52.500724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2afccb-3bca-4255-90e2-1b4087e74830 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:52.500993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2afccb-3bca-4255-90e2-1b4087e74830 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:52.511317 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2afccb-3bca-4255-90e2-1b4087e74830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-3a2afccb-3bca-4255-90e2-1b4087e74830 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:48:52.516200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:48:52.517245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:48:52.518476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:48:52.518476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:48:52.518476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:48:52.518476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:48:52.518476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:48:52.518476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:48:52.518476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:48:52.518476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:48:52.518476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:48:52.518476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:48:52.518476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:48:52.518476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:48:52.518476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 412/834] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:48:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:48:52.523321 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f0f99-f71e-453e-9d3d-a18678209d64 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:52.570109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:52.618748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f0f99-f71e-453e-9d3d-a18678209d64 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:52.651382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b6d1-2adb-4c36-b30b-76e4937e83a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:52.651981 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b6d1-2adb-4c36-b30b-76e4937e83a9 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:52.652254 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b6d1-2adb-4c36-b30b-76e4937e83a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:52.652517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b6d1-2adb-4c36-b30b-76e4937e83a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:52.653163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4b6d1-2adb-4c36-b30b-76e4937e83a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:52.653488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4b6d1-2adb-4c36-b30b-76e4937e83a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:52.654835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4b6d1-2adb-4c36-b30b-76e4937e83a9 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:52.663336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 423/835] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:48:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:52.669150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2afccb-3bca-4255-90e2-1b4087e74830 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:52.716120 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:52.764405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2afccb-3bca-4255-90e2-1b4087e74830 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:52.796335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7da5a-8020-49e8-be9f-2526608bb97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:52.796934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7da5a-8020-49e8-be9f-2526608bb97f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:52.797206 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7da5a-8020-49e8-be9f-2526608bb97f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:52.797498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7da5a-8020-49e8-be9f-2526608bb97f None admin] PATH_INFO: `/v3/users/b83f1c611e5d434b9af0204ce553c48b` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:52.798575 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7da5a-8020-49e8-be9f-2526608bb97f None admin] RBAC: Authorizing `identity:get_user(user_id=b83f1c611e5d434b9af0204ce553c48b)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:52.799990 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7da5a-8020-49e8-be9f-2526608bb97f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:52.801540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 413/836] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:48:52 2022] GET /identity/v3/users/b83f1c611e5d434b9af0204ce553c48b => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:52.807261 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b6d1-2adb-4c36-b30b-76e4937e83a9 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:52.905057 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b6d1-2adb-4c36-b30b-76e4937e83a9 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:52.915055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:52.937888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bce0b-82c7-4e2e-9c93-a4ce6c804020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:52.938482 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bce0b-82c7-4e2e-9c93-a4ce6c804020 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:52.938758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bce0b-82c7-4e2e-9c93-a4ce6c804020 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:52.939041 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bce0b-82c7-4e2e-9c93-a4ce6c804020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:53.005199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bce0b-82c7-4e2e-9c93-a4ce6c804020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:53.007383 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bce0b-82c7-4e2e-9c93-a4ce6c804020 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:53.101665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 424/837] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:48:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 14:48:53.107553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7da5a-8020-49e8-be9f-2526608bb97f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:53.204687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7da5a-8020-49e8-be9f-2526608bb97f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:53.219976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:53.238074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d51c3-adde-40c0-b259-ad2256db62f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:53.238774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d51c3-adde-40c0-b259-ad2256db62f4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:53.239155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d51c3-adde-40c0-b259-ad2256db62f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:53.239477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d51c3-adde-40c0-b259-ad2256db62f4 None admin] PATH_INFO: `/v3/projects/5847f4001398433abc4f485f2b821225` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:53.241253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d51c3-adde-40c0-b259-ad2256db62f4 None admin] RBAC: Authorizing `identity:get_project(project_id=5847f4001398433abc4f485f2b821225)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:53.242691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d51c3-adde-40c0-b259-ad2256db62f4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:53.244287 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 414/838] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:48:53 2022] GET /identity/v3/projects/5847f4001398433abc4f485f2b821225 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:53.250363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bce0b-82c7-4e2e-9c93-a4ce6c804020 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:53.261673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:53.346080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bce0b-82c7-4e2e-9c93-a4ce6c804020 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:53.380362 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b86152-b0ef-4327-b678-250536cca2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:53.381231 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b86152-b0ef-4327-b678-250536cca2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:53.381533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b86152-b0ef-4327-b678-250536cca2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:53.381805 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b86152-b0ef-4327-b678-250536cca2f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:53.382515 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b86152-b0ef-4327-b678-250536cca2f0 None admin] RBAC: Adding query filter params (role.id=c62ffefc63e74a1280bef2b6a22202ad, scope.project.id=5847f4001398433abc4f485f2b821225, user.id=b83f1c611e5d434b9af0204ce553c48b) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:48:53.382912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b86152-b0ef-4327-b678-250536cca2f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:53.384317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b86152-b0ef-4327-b678-250536cca2f0 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:53.389972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 425/839] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:48:53 2022] GET /identity/v3/role_assignments?user.id=b83f1c611e5d434b9af0204ce553c48b&scope.project.id=5847f4001398433abc4f485f2b821225&role.id=c62ffefc63e74a1280bef2b6a22202ad => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:55.501240 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b9dc5-ff17-4c3e-802c-e91d2ee55f60 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:55.501794 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b9dc5-ff17-4c3e-802c-e91d2ee55f60 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:55.501794 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b9dc5-ff17-4c3e-802c-e91d2ee55f60 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:55.503113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 415/840] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:55.508851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ef14b-b75b-4c19-a012-9ea650c0d852 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:55.509265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ef14b-b75b-4c19-a012-9ea650c0d852 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:55.509407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ef14b-b75b-4c19-a012-9ea650c0d852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:55.527902 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-c99ef14b-b75b-4c19-a012-9ea650c0d852 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:55.529059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c99ef14b-b75b-4c19-a012-9ea650c0d852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:55.592669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 426/841] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:55.860302 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b9dc5-ff17-4c3e-802c-e91d2ee55f60 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:55.957754 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b9dc5-ff17-4c3e-802c-e91d2ee55f60 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:55.990988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb32a5-891e-4f34-9f22-cb4d4be95a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:55.991609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb32a5-891e-4f34-9f22-cb4d4be95a2c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:55.991884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb32a5-891e-4f34-9f22-cb4d4be95a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:55.992151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb32a5-891e-4f34-9f22-cb4d4be95a2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:55.993251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb32a5-891e-4f34-9f22-cb4d4be95a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:55.994678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb32a5-891e-4f34-9f22-cb4d4be95a2c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:55.996222 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 416/842] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:56.002100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ef14b-b75b-4c19-a012-9ea650c0d852 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:56.005184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:56.098721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ef14b-b75b-4c19-a012-9ea650c0d852 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:56.132504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b76b01-b104-453e-8825-db8a32f4f11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:56.133070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b76b01-b104-453e-8825-db8a32f4f11a None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:56.133376 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b76b01-b104-453e-8825-db8a32f4f11a None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:56.133647 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b76b01-b104-453e-8825-db8a32f4f11a None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:56.134284 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b76b01-b104-453e-8825-db8a32f4f11a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:56.135703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b76b01-b104-453e-8825-db8a32f4f11a None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:56.251016 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 427/843] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:48:56 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:48:58.426771 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b859bbb-f233-42f7-9777-8813ee118b3c None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:58.427904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b859bbb-f233-42f7-9777-8813ee118b3c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:58.427904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b859bbb-f233-42f7-9777-8813ee118b3c None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:58.429175 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 417/844] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:48:58.434477 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9709c-1cc8-46a4-8bf5-7611fe34e101 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:58.434890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9709c-1cc8-46a4-8bf5-7611fe34e101 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:58.435021 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9709c-1cc8-46a4-8bf5-7611fe34e101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:58.455494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-fad9709c-1cc8-46a4-8bf5-7611fe34e101 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:48:58.456673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-fad9709c-1cc8-46a4-8bf5-7611fe34e101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:48:58.510447 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:58.521098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 428/845] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:48:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:48:58.795648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b859bbb-f233-42f7-9777-8813ee118b3c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:58.847666 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:58.892596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b859bbb-f233-42f7-9777-8813ee118b3c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:58.925027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763bfdd-72a6-46ee-8b6b-ff9da568d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:58.925657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763bfdd-72a6-46ee-8b6b-ff9da568d3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:58.925935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763bfdd-72a6-46ee-8b6b-ff9da568d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:58.926203 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763bfdd-72a6-46ee-8b6b-ff9da568d3d9 None admin] PATH_INFO: `/v3/roles/80aa63d20ae84a66991d542b3ed87f66` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:58.928067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763bfdd-72a6-46ee-8b6b-ff9da568d3d9 None admin] RBAC: Authorizing `identity:get_role(role_id=80aa63d20ae84a66991d542b3ed87f66)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:58.929458 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763bfdd-72a6-46ee-8b6b-ff9da568d3d9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:58.930741 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 418/846] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:48:58 2022] GET /identity/v3/roles/80aa63d20ae84a66991d542b3ed87f66 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:58.936587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9709c-1cc8-46a4-8bf5-7611fe34e101 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:59.034373 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9709c-1cc8-46a4-8bf5-7611fe34e101 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:59.068456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312eb49-9182-44f9-86d1-e4bc95614f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:59.069076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312eb49-9182-44f9-86d1-e4bc95614f31 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:59.069375 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312eb49-9182-44f9-86d1-e4bc95614f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:59.069649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312eb49-9182-44f9-86d1-e4bc95614f31 None admin] PATH_INFO: `/v3/users/7a164be31da94ca08bc9b40576f4a96b` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:59.082259 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312eb49-9182-44f9-86d1-e4bc95614f31 None admin] RBAC: Authorizing `identity:get_user(user_id=7a164be31da94ca08bc9b40576f4a96b)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:59.083715 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312eb49-9182-44f9-86d1-e4bc95614f31 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:59.085363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 429/847] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:48:58 2022] GET /identity/v3/users/7a164be31da94ca08bc9b40576f4a96b => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:59.091101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763bfdd-72a6-46ee-8b6b-ff9da568d3d9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:59.187199 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763bfdd-72a6-46ee-8b6b-ff9da568d3d9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:59.206378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:59.219529 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16307f45-f5a8-47f1-a5c7-dbc246f0b12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:59.220140 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307f45-f5a8-47f1-a5c7-dbc246f0b12f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:59.220414 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307f45-f5a8-47f1-a5c7-dbc246f0b12f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:59.220682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307f45-f5a8-47f1-a5c7-dbc246f0b12f None admin] PATH_INFO: `/v3/projects/5847f4001398433abc4f485f2b821225` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:59.221788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16307f45-f5a8-47f1-a5c7-dbc246f0b12f None admin] RBAC: Authorizing `identity:get_project(project_id=5847f4001398433abc4f485f2b821225)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:59.223205 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16307f45-f5a8-47f1-a5c7-dbc246f0b12f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:59.225388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 419/848] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:48:59 2022] GET /identity/v3/projects/5847f4001398433abc4f485f2b821225 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:48:59.231308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312eb49-9182-44f9-86d1-e4bc95614f31 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:48:59.279797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:48:59.328794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312eb49-9182-44f9-86d1-e4bc95614f31 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:48:59.361141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb339c6d-e8ad-4b9d-97c5-90f31b555a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:48:59.361811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb339c6d-e8ad-4b9d-97c5-90f31b555a8d None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:48:59.362087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb339c6d-e8ad-4b9d-97c5-90f31b555a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:48:59.362356 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb339c6d-e8ad-4b9d-97c5-90f31b555a8d None admin] PATH_INFO: `/v3/projects/5847f4001398433abc4f485f2b821225/users/7a164be31da94ca08bc9b40576f4a96b/roles/80aa63d20ae84a66991d542b3ed87f66` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:48:59.364464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb339c6d-e8ad-4b9d-97c5-90f31b555a8d None admin] RBAC: Authorizing `identity:create_grant(project_id=5847f4001398433abc4f485f2b821225, user_id=7a164be31da94ca08bc9b40576f4a96b, role_id=80aa63d20ae84a66991d542b3ed87f66)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:48:59.366505 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb339c6d-e8ad-4b9d-97c5-90f31b555a8d None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:48:59.458234 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 430/849] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:48:59 2022] PUT /identity/v3/projects/5847f4001398433abc4f485f2b821225/users/7a164be31da94ca08bc9b40576f4a96b/roles/80aa63d20ae84a66991d542b3ed87f66 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:01.586703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a55eb-631a-4a8a-ae0a-20f19a91f4c0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:01.587235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a55eb-631a-4a8a-ae0a-20f19a91f4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:01.587235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a55eb-631a-4a8a-ae0a-20f19a91f4c0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:01.588541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 420/850] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:49:01.593712 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d163f-278f-40f6-8ec9-231e6c019b1c None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:01.594089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d163f-278f-40f6-8ec9-231e6c019b1c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:01.594251 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d163f-278f-40f6-8ec9-231e6c019b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:01.613151 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-7d5d163f-278f-40f6-8ec9-231e6c019b1c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:01.614342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7d5d163f-278f-40f6-8ec9-231e6c019b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:01.793498 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 431/851] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:49:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:49:02.063945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a55eb-631a-4a8a-ae0a-20f19a91f4c0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:02.165168 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a55eb-631a-4a8a-ae0a-20f19a91f4c0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:02.196340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db099a0-d700-47e1-b573-2ce82d2d8bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:02.196950 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db099a0-d700-47e1-b573-2ce82d2d8bdb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:02.197227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db099a0-d700-47e1-b573-2ce82d2d8bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:02.197528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db099a0-d700-47e1-b573-2ce82d2d8bdb None admin] PATH_INFO: `/v3/roles/80aa63d20ae84a66991d542b3ed87f66` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:02.198888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db099a0-d700-47e1-b573-2ce82d2d8bdb None admin] RBAC: Authorizing `identity:get_role(role_id=80aa63d20ae84a66991d542b3ed87f66)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:02.200249 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db099a0-d700-47e1-b573-2ce82d2d8bdb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:02.201580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 421/852] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:49:02 2022] GET /identity/v3/roles/80aa63d20ae84a66991d542b3ed87f66 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:02.207379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d163f-278f-40f6-8ec9-231e6c019b1c None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:02.245704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:02.305162 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d163f-278f-40f6-8ec9-231e6c019b1c None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:02.343255 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf386b70-7c0b-4fd6-889b-e8a1493d4da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:02.343878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf386b70-7c0b-4fd6-889b-e8a1493d4da6 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:02.344147 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf386b70-7c0b-4fd6-889b-e8a1493d4da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:02.344411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf386b70-7c0b-4fd6-889b-e8a1493d4da6 None admin] PATH_INFO: `/v3/users/7a164be31da94ca08bc9b40576f4a96b` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:02.345546 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf386b70-7c0b-4fd6-889b-e8a1493d4da6 None admin] RBAC: Authorizing `identity:get_user(user_id=7a164be31da94ca08bc9b40576f4a96b)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:02.347069 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf386b70-7c0b-4fd6-889b-e8a1493d4da6 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:02.348617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 432/853] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:49:02 2022] GET /identity/v3/users/7a164be31da94ca08bc9b40576f4a96b => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:02.354750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db099a0-d700-47e1-b573-2ce82d2d8bdb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:02.410528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:02.454412 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db099a0-d700-47e1-b573-2ce82d2d8bdb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:02.491672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281b4c7-3697-47d7-8d7c-1dd7917b03d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:02.492283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281b4c7-3697-47d7-8d7c-1dd7917b03d5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:02.492563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281b4c7-3697-47d7-8d7c-1dd7917b03d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:02.492864 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281b4c7-3697-47d7-8d7c-1dd7917b03d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:02.558285 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281b4c7-3697-47d7-8d7c-1dd7917b03d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:02.559636 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281b4c7-3697-47d7-8d7c-1dd7917b03d5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:02.610579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:02.652336 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 422/854] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:49:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 14:49:02.658668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf386b70-7c0b-4fd6-889b-e8a1493d4da6 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:02.753203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf386b70-7c0b-4fd6-889b-e8a1493d4da6 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:02.760355 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:02.786162 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03436aac-0908-4092-be79-1c933e35b0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:02.786903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03436aac-0908-4092-be79-1c933e35b0ef None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:02.787174 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03436aac-0908-4092-be79-1c933e35b0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:02.787437 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03436aac-0908-4092-be79-1c933e35b0ef None admin] PATH_INFO: `/v3/projects/5847f4001398433abc4f485f2b821225` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:02.788549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03436aac-0908-4092-be79-1c933e35b0ef None admin] RBAC: Authorizing `identity:get_project(project_id=5847f4001398433abc4f485f2b821225)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:02.790264 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03436aac-0908-4092-be79-1c933e35b0ef None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:02.792139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 433/855] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:49:02 2022] GET /identity/v3/projects/5847f4001398433abc4f485f2b821225 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:02.798346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281b4c7-3697-47d7-8d7c-1dd7917b03d5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:02.895682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281b4c7-3697-47d7-8d7c-1dd7917b03d5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:02.928261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad6269-6d34-4028-aa51-c41b3379c0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:02.928849 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad6269-6d34-4028-aa51-c41b3379c0ea None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:02.929126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad6269-6d34-4028-aa51-c41b3379c0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:02.929422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad6269-6d34-4028-aa51-c41b3379c0ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:02.930131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad6269-6d34-4028-aa51-c41b3379c0ea None admin] RBAC: Adding query filter params (role.id=80aa63d20ae84a66991d542b3ed87f66, scope.project.id=5847f4001398433abc4f485f2b821225, user.id=7a164be31da94ca08bc9b40576f4a96b) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:02.930435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad6269-6d34-4028-aa51-c41b3379c0ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:02.931834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad6269-6d34-4028-aa51-c41b3379c0ea None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:02.937295 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 423/856] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:49:02 2022] GET /identity/v3/role_assignments?user.id=7a164be31da94ca08bc9b40576f4a96b&scope.project.id=5847f4001398433abc4f485f2b821225&role.id=80aa63d20ae84a66991d542b3ed87f66 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:49:05.059086 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261c513-bde0-45fc-9f42-63c2f07546a0 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:05.059569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261c513-bde0-45fc-9f42-63c2f07546a0 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:05.059654 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261c513-bde0-45fc-9f42-63c2f07546a0 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:05.060926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 434/857] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:49:05.066095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c3bf6-3c69-4127-8185-14ea0e716390 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:05.066506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c3bf6-3c69-4127-8185-14ea0e716390 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:05.066645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c3bf6-3c69-4127-8185-14ea0e716390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:05.084671 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-434c3bf6-3c69-4127-8185-14ea0e716390 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:05.085893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-434c3bf6-3c69-4127-8185-14ea0e716390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:05.099942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:05.149694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 424/858] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:49:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:49:05.447703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261c513-bde0-45fc-9f42-63c2f07546a0 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:05.544745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261c513-bde0-45fc-9f42-63c2f07546a0 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:05.576858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124af6-7c3b-4f97-b331-76d0a83c2d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:05.577487 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124af6-7c3b-4f97-b331-76d0a83c2d41 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:05.577759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124af6-7c3b-4f97-b331-76d0a83c2d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:05.578023 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124af6-7c3b-4f97-b331-76d0a83c2d41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:05.579100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07124af6-7c3b-4f97-b331-76d0a83c2d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:05.580509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07124af6-7c3b-4f97-b331-76d0a83c2d41 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:05.582052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 435/859] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:49:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:05.588857 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c3bf6-3c69-4127-8185-14ea0e716390 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:05.685625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c3bf6-3c69-4127-8185-14ea0e716390 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:05.718779 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c553a4-d109-4620-a131-d1af9588ca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:05.719323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c553a4-d109-4620-a131-d1af9588ca47 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:05.719601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c553a4-d109-4620-a131-d1af9588ca47 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:05.719872 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c553a4-d109-4620-a131-d1af9588ca47 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:05.720509 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c553a4-d109-4620-a131-d1af9588ca47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:05.721955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c553a4-d109-4620-a131-d1af9588ca47 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:05.835526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 425/860] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:49:05 2022] POST /identity/v3/projects => generated 311 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:07.998918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd998cf8-7b25-4c17-857a-9db3299ccee6 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:07.999425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd998cf8-7b25-4c17-857a-9db3299ccee6 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:07.999522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd998cf8-7b25-4c17-857a-9db3299ccee6 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:08.000805 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 436/861] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:49:08.006703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c826a-fee2-42d4-9fb0-692032cc79a3 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:08.007102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c826a-fee2-42d4-9fb0-692032cc79a3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:08.007243 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c826a-fee2-42d4-9fb0-692032cc79a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:08.013489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:08.025251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7c9c826a-fee2-42d4-9fb0-692032cc79a3 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:08.037078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7c9c826a-fee2-42d4-9fb0-692032cc79a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:08.089833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 426/862] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:49:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:49:08.361012 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd998cf8-7b25-4c17-857a-9db3299ccee6 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:08.404061 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:08.460073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd998cf8-7b25-4c17-857a-9db3299ccee6 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:08.493409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baad388-1edf-4bb0-aca6-040c79821c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:08.494015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baad388-1edf-4bb0-aca6-040c79821c96 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:08.494286 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baad388-1edf-4bb0-aca6-040c79821c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:08.494549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baad388-1edf-4bb0-aca6-040c79821c96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:08.495613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baad388-1edf-4bb0-aca6-040c79821c96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:08.497008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baad388-1edf-4bb0-aca6-040c79821c96 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:08.498548 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 437/863] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:08.504352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c826a-fee2-42d4-9fb0-692032cc79a3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:08.597845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c826a-fee2-42d4-9fb0-692032cc79a3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:08.625747 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:08.630447 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f8853-3261-42cb-807d-8f5eee73f3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:08.631036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f8853-3261-42cb-807d-8f5eee73f3bb None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:08.631313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f8853-3261-42cb-807d-8f5eee73f3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:08.631583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f8853-3261-42cb-807d-8f5eee73f3bb None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:08.632217 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f8853-3261-42cb-807d-8f5eee73f3bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:08.633645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f8853-3261-42cb-807d-8f5eee73f3bb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:08.755159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 427/864] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:49:08 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:10.916927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4f623-0099-42df-a3c6-d34e962de5ab None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:10.917519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4f623-0099-42df-a3c6-d34e962de5ab None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:10.917519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4f623-0099-42df-a3c6-d34e962de5ab None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:10.918801 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 438/865] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:49:10.923996 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ac28-7a7d-492e-af24-87edf23ed052 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:10.924433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ac28-7a7d-492e-af24-87edf23ed052 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:10.924556 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ac28-7a7d-492e-af24-87edf23ed052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:10.943561 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5751ac28-7a7d-492e-af24-87edf23ed052 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:10.944726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5751ac28-7a7d-492e-af24-87edf23ed052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:11.008783 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 428/866] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:49:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:49:11.273369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4f623-0099-42df-a3c6-d34e962de5ab None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:11.371657 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4f623-0099-42df-a3c6-d34e962de5ab None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:11.381862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:11.403468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63125b8-075a-447e-b32a-2e2166f6f787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:11.404069 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63125b8-075a-447e-b32a-2e2166f6f787 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:11.404340 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63125b8-075a-447e-b32a-2e2166f6f787 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:11.404604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63125b8-075a-447e-b32a-2e2166f6f787 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:11.415438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63125b8-075a-447e-b32a-2e2166f6f787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-c63125b8-075a-447e-b32a-2e2166f6f787 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:49:11.420136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:49:11.421304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:49:11.422419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:49:11.422419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:49:11.422419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:49:11.422419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:49:11.422419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:49:11.422419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:49:11.422419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:49:11.422419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:49:11.422419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:49:11.422419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:49:11.422419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:49:11.422419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:49:11.422419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 439/867] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:49:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:49:11.427936 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751ac28-7a7d-492e-af24-87edf23ed052 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:11.522258 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751ac28-7a7d-492e-af24-87edf23ed052 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:11.539375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:11.555277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8414305-9864-4c1e-8859-2ad7f8214d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:11.555870 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8414305-9864-4c1e-8859-2ad7f8214d91 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:11.556147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8414305-9864-4c1e-8859-2ad7f8214d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:11.556416 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8414305-9864-4c1e-8859-2ad7f8214d91 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:11.557068 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8414305-9864-4c1e-8859-2ad7f8214d91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:11.557395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8414305-9864-4c1e-8859-2ad7f8214d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:11.558751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8414305-9864-4c1e-8859-2ad7f8214d91 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:11.566451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 429/868] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:49:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:11.572404 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63125b8-075a-447e-b32a-2e2166f6f787 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:11.671200 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63125b8-075a-447e-b32a-2e2166f6f787 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:11.703103 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481057a-a30a-45c0-84e3-7127a58da920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:11.703704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481057a-a30a-45c0-84e3-7127a58da920 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:11.703973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481057a-a30a-45c0-84e3-7127a58da920 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:11.704234 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481057a-a30a-45c0-84e3-7127a58da920 None admin] PATH_INFO: `/v3/users/15be600c7c854d2fae4e19066d991c23` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:11.717390 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481057a-a30a-45c0-84e3-7127a58da920 None admin] RBAC: Authorizing `identity:get_user(user_id=15be600c7c854d2fae4e19066d991c23)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:11.718803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481057a-a30a-45c0-84e3-7127a58da920 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:11.720342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 440/869] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:49:11 2022] GET /identity/v3/users/15be600c7c854d2fae4e19066d991c23 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:11.726650 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8414305-9864-4c1e-8859-2ad7f8214d91 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:11.821858 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8414305-9864-4c1e-8859-2ad7f8214d91 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:11.854598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d19816-3674-4a9e-ab0e-8081856fb4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:11.855210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d19816-3674-4a9e-ab0e-8081856fb4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:11.855486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d19816-3674-4a9e-ab0e-8081856fb4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:11.855755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d19816-3674-4a9e-ab0e-8081856fb4d1 None admin] PATH_INFO: `/v3/projects/5c9eafc2fcf84d33a0a5c01a31aa7e77` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:11.856843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d19816-3674-4a9e-ab0e-8081856fb4d1 None admin] RBAC: Authorizing `identity:get_project(project_id=5c9eafc2fcf84d33a0a5c01a31aa7e77)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:11.858272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d19816-3674-4a9e-ab0e-8081856fb4d1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:11.859849 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 430/870] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:49:11 2022] GET /identity/v3/projects/5c9eafc2fcf84d33a0a5c01a31aa7e77 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:11.865866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481057a-a30a-45c0-84e3-7127a58da920 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:11.892607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:11.962104 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481057a-a30a-45c0-84e3-7127a58da920 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:11.995803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6fdd6-18d5-4e23-a1bd-5dfe66173154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:11.996445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6fdd6-18d5-4e23-a1bd-5dfe66173154 None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:11.996716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6fdd6-18d5-4e23-a1bd-5dfe66173154 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:11.996980 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6fdd6-18d5-4e23-a1bd-5dfe66173154 None admin] PATH_INFO: `/v3/projects/5c9eafc2fcf84d33a0a5c01a31aa7e77/users/15be600c7c854d2fae4e19066d991c23/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:11.998841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6fdd6-18d5-4e23-a1bd-5dfe66173154 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c9eafc2fcf84d33a0a5c01a31aa7e77, user_id=15be600c7c854d2fae4e19066d991c23, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:12.000244 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6fdd6-18d5-4e23-a1bd-5dfe66173154 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:12.126466 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 441/871] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:49:11 2022] PUT /identity/v3/projects/5c9eafc2fcf84d33a0a5c01a31aa7e77/users/15be600c7c854d2fae4e19066d991c23/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:14.231314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35074682-2e32-4911-a2d1-23f02834384f None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:14.231834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35074682-2e32-4911-a2d1-23f02834384f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:14.231834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35074682-2e32-4911-a2d1-23f02834384f None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:14.233092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 431/872] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:49:14.238190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056b683-fd62-4032-a4d1-d08fd3fda749 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:14.238628 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056b683-fd62-4032-a4d1-d08fd3fda749 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:14.238720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056b683-fd62-4032-a4d1-d08fd3fda749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:14.256823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e056b683-fd62-4032-a4d1-d08fd3fda749 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:14.258032 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e056b683-fd62-4032-a4d1-d08fd3fda749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:14.323045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 442/873] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:49:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:49:14.592363 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35074682-2e32-4911-a2d1-23f02834384f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:14.668376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:14.702842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35074682-2e32-4911-a2d1-23f02834384f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:14.734573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c51a3-0859-471c-87f3-fd1cd4c39a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:14.735180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c51a3-0859-471c-87f3-fd1cd4c39a47 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:14.735453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c51a3-0859-471c-87f3-fd1cd4c39a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:14.735719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c51a3-0859-471c-87f3-fd1cd4c39a47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:14.859701 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c51a3-0859-471c-87f3-fd1cd4c39a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-ec5c51a3-0859-471c-87f3-fd1cd4c39a47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:49:14.865129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:49:14.866254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:49:14.867479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:49:14.867479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:49:14.867479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:49:14.867479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:49:14.867479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:49:14.867479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:49:14.867479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:49:14.867479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:49:14.867479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:49:14.867479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:49:14.867479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:49:14.867479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:49:14.867479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 432/874] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:49:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:49:14.872314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056b683-fd62-4032-a4d1-d08fd3fda749 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:14.890913 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:14.970215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056b683-fd62-4032-a4d1-d08fd3fda749 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:15.004680 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a2d46-0fef-4aef-8516-646a166b86a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:15.005880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a2d46-0fef-4aef-8516-646a166b86a7 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:15.006157 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a2d46-0fef-4aef-8516-646a166b86a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:15.006423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a2d46-0fef-4aef-8516-646a166b86a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:15.007080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a2d46-0fef-4aef-8516-646a166b86a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:15.007378 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a2d46-0fef-4aef-8516-646a166b86a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:15.008734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a2d46-0fef-4aef-8516-646a166b86a7 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:15.016531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 443/875] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:15.023088 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c51a3-0859-471c-87f3-fd1cd4c39a47 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:15.117555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c51a3-0859-471c-87f3-fd1cd4c39a47 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:15.125686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:15.149883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9528f3-2fa3-404e-8826-de9bee743060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:15.150484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9528f3-2fa3-404e-8826-de9bee743060 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:15.150755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9528f3-2fa3-404e-8826-de9bee743060 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:15.151036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9528f3-2fa3-404e-8826-de9bee743060 None admin] PATH_INFO: `/v3/users/15be600c7c854d2fae4e19066d991c23` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:15.152099 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9528f3-2fa3-404e-8826-de9bee743060 None admin] RBAC: Authorizing `identity:get_user(user_id=15be600c7c854d2fae4e19066d991c23)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:15.153520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9528f3-2fa3-404e-8826-de9bee743060 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:15.155040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 433/876] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:49:15 2022] GET /identity/v3/users/15be600c7c854d2fae4e19066d991c23 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:15.161102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a2d46-0fef-4aef-8516-646a166b86a7 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:15.240261 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:15.258940 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a2d46-0fef-4aef-8516-646a166b86a7 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:15.292175 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad27f05-3c0c-40dd-b91c-ca7e9b23ae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:15.292770 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad27f05-3c0c-40dd-b91c-ca7e9b23ae81 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:15.293047 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad27f05-3c0c-40dd-b91c-ca7e9b23ae81 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:15.293339 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad27f05-3c0c-40dd-b91c-ca7e9b23ae81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:15.358880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad27f05-3c0c-40dd-b91c-ca7e9b23ae81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:15.360302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad27f05-3c0c-40dd-b91c-ca7e9b23ae81 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:15.435553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:15.454892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 444/877] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:49:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 14:49:15.460885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9528f3-2fa3-404e-8826-de9bee743060 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:15.557896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9528f3-2fa3-404e-8826-de9bee743060 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:15.590331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fa57a-0db4-4644-9c86-6f7a02c7989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:15.590944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fa57a-0db4-4644-9c86-6f7a02c7989f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:15.591221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fa57a-0db4-4644-9c86-6f7a02c7989f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:15.591489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fa57a-0db4-4644-9c86-6f7a02c7989f None admin] PATH_INFO: `/v3/projects/5c9eafc2fcf84d33a0a5c01a31aa7e77` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:15.592579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fa57a-0db4-4644-9c86-6f7a02c7989f None admin] RBAC: Authorizing `identity:get_project(project_id=5c9eafc2fcf84d33a0a5c01a31aa7e77)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:15.594043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fa57a-0db4-4644-9c86-6f7a02c7989f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:15.595670 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 434/878] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:49:15 2022] GET /identity/v3/projects/5c9eafc2fcf84d33a0a5c01a31aa7e77 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:15.601916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad27f05-3c0c-40dd-b91c-ca7e9b23ae81 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:15.696808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad27f05-3c0c-40dd-b91c-ca7e9b23ae81 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:15.728952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3e95b-aac3-4ed8-9651-12fb4d447064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:15.729551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e95b-aac3-4ed8-9651-12fb4d447064 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:15.729820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e95b-aac3-4ed8-9651-12fb4d447064 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:15.730081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3e95b-aac3-4ed8-9651-12fb4d447064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:15.730777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e95b-aac3-4ed8-9651-12fb4d447064 None admin] RBAC: Adding query filter params (role.id=c62ffefc63e74a1280bef2b6a22202ad, scope.project.id=5c9eafc2fcf84d33a0a5c01a31aa7e77, user.id=15be600c7c854d2fae4e19066d991c23) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:15.731070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e95b-aac3-4ed8-9651-12fb4d447064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:15.732457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3e95b-aac3-4ed8-9651-12fb4d447064 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:15.737901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 445/879] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:49:15 2022] GET /identity/v3/role_assignments?user.id=15be600c7c854d2fae4e19066d991c23&scope.project.id=5c9eafc2fcf84d33a0a5c01a31aa7e77&role.id=c62ffefc63e74a1280bef2b6a22202ad => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:17.871707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37193c79-51ed-49bd-9019-5a4564dae1d1 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:17.872270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37193c79-51ed-49bd-9019-5a4564dae1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:17.872270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37193c79-51ed-49bd-9019-5a4564dae1d1 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:17.873615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 435/880] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:49:17.878939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef999e3a-2131-416e-adf7-818f36c69ed2 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:17.879354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef999e3a-2131-416e-adf7-818f36c69ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:17.879479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef999e3a-2131-416e-adf7-818f36c69ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:17.897874 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-ef999e3a-2131-416e-adf7-818f36c69ed2 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:17.899057 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ef999e3a-2131-416e-adf7-818f36c69ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:17.937940 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:17.964081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 446/881] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:49:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:49:18.238314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37193c79-51ed-49bd-9019-5a4564dae1d1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:18.284388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:18.339542 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37193c79-51ed-49bd-9019-5a4564dae1d1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:18.371656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5f0d6-a614-41ff-a61f-1f965093bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:18.372252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5f0d6-a614-41ff-a61f-1f965093bc1f None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:18.372527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5f0d6-a614-41ff-a61f-1f965093bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:18.372792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5f0d6-a614-41ff-a61f-1f965093bc1f None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:18.373483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5f0d6-a614-41ff-a61f-1f965093bc1f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:18.374831 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5f0d6-a614-41ff-a61f-1f965093bc1f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:18.474786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 436/882] 10.222.0.45 () {60 vars in 1138 bytes} [Mon Oct 31 14:49:18 2022] POST /identity/v3/domains => generated 267 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:20.677656 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ab153-d784-4c38-998b-0eb87cadeec5 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:20.678186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ab153-d784-4c38-998b-0eb87cadeec5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:20.678186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ab153-d784-4c38-998b-0eb87cadeec5 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:20.679539 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 447/883] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:49:20.684978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437315e9-4faf-4428-b793-488785d21549 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:20.685435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437315e9-4faf-4428-b793-488785d21549 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:20.685526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437315e9-4faf-4428-b793-488785d21549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:20.703187 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-437315e9-4faf-4428-b793-488785d21549 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:20.704361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-437315e9-4faf-4428-b793-488785d21549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:20.768149 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 437/884] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:49:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:49:21.042659 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ab153-d784-4c38-998b-0eb87cadeec5 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:21.139668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ab153-d784-4c38-998b-0eb87cadeec5 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:21.172334 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25b7b0-bf5b-4413-843d-db0ad54970b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:21.172944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25b7b0-bf5b-4413-843d-db0ad54970b6 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:21.173218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25b7b0-bf5b-4413-843d-db0ad54970b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:21.173513 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25b7b0-bf5b-4413-843d-db0ad54970b6 None admin] PATH_INFO: `/v3/domains/90f5326d35f64910b66f67b35a954e3f` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:21.183572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25b7b0-bf5b-4413-843d-db0ad54970b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=90f5326d35f64910b66f67b35a954e3f)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:21.184995 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25b7b0-bf5b-4413-843d-db0ad54970b6 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:21.186571 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 448/885] 10.222.0.45 () {56 vars in 1183 bytes} [Mon Oct 31 14:49:21 2022] GET /identity/v3/domains/90f5326d35f64910b66f67b35a954e3f => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:21.192847 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437315e9-4faf-4428-b793-488785d21549 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:21.225106 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:21.288039 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437315e9-4faf-4428-b793-488785d21549 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:21.320716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8147c-e1b3-40a1-bd55-d1cd3408cd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:21.321324 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8147c-e1b3-40a1-bd55-d1cd3408cd27 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:21.321605 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8147c-e1b3-40a1-bd55-d1cd3408cd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:21.321874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8147c-e1b3-40a1-bd55-d1cd3408cd27 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:21.322511 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8147c-e1b3-40a1-bd55-d1cd3408cd27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:21.323913 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8147c-e1b3-40a1-bd55-d1cd3408cd27 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:21.435984 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 438/886] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:49:21 2022] POST /identity/v3/projects => generated 361 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:23.582918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b0df4-fc78-4953-8611-7c9d57ebd41f None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:23.583517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b0df4-fc78-4953-8611-7c9d57ebd41f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:23.583517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b0df4-fc78-4953-8611-7c9d57ebd41f None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:23.584756 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 449/887] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:49:23.589949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82471d-4b4d-453e-a463-2057e4f0822b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:23.590365 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82471d-4b4d-453e-a463-2057e4f0822b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:23.590500 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82471d-4b4d-453e-a463-2057e4f0822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:23.608915 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8f82471d-4b4d-453e-a463-2057e4f0822b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:23.610118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8f82471d-4b4d-453e-a463-2057e4f0822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:23.674316 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 439/888] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:49:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:49:23.945814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b0df4-fc78-4953-8611-7c9d57ebd41f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:23.983173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:24.048449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b0df4-fc78-4953-8611-7c9d57ebd41f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:24.080862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a730b7-f6d4-4d29-9399-7c9c0b028463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:24.081496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a730b7-f6d4-4d29-9399-7c9c0b028463 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:24.081774 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a730b7-f6d4-4d29-9399-7c9c0b028463 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:24.082042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a730b7-f6d4-4d29-9399-7c9c0b028463 None admin] PATH_INFO: `/v3/domains/90f5326d35f64910b66f67b35a954e3f` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:24.083723 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a730b7-f6d4-4d29-9399-7c9c0b028463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=90f5326d35f64910b66f67b35a954e3f)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:24.085129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a730b7-f6d4-4d29-9399-7c9c0b028463 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:24.086696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 450/889] 10.222.0.45 () {56 vars in 1183 bytes} [Mon Oct 31 14:49:23 2022] GET /identity/v3/domains/90f5326d35f64910b66f67b35a954e3f => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:24.092466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82471d-4b4d-453e-a463-2057e4f0822b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:24.109018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:24.187044 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82471d-4b4d-453e-a463-2057e4f0822b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:24.219920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bbe0f-cc53-48d1-aa0a-14e57884a698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:24.220459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bbe0f-cc53-48d1-aa0a-14e57884a698 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:24.220734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bbe0f-cc53-48d1-aa0a-14e57884a698 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:24.221001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bbe0f-cc53-48d1-aa0a-14e57884a698 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:24.221676 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bbe0f-cc53-48d1-aa0a-14e57884a698 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:24.223088 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bbe0f-cc53-48d1-aa0a-14e57884a698 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:24.295895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 440/890] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:49:24 2022] POST /identity/v3/users => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:49:26.453629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f62ed-c582-4455-829b-080632e9c776 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:26.454188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f62ed-c582-4455-829b-080632e9c776 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:26.454188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f62ed-c582-4455-829b-080632e9c776 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:26.455535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 451/891] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:49:26.462022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276e109-c591-4dfd-9ba4-c631fb5b5737 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:26.462464 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276e109-c591-4dfd-9ba4-c631fb5b5737 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:26.462594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276e109-c591-4dfd-9ba4-c631fb5b5737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:26.480760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b276e109-c591-4dfd-9ba4-c631fb5b5737 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:26.481999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b276e109-c591-4dfd-9ba4-c631fb5b5737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:26.548597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 441/892] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:49:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:49:26.833775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f62ed-c582-4455-829b-080632e9c776 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:26.944379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f62ed-c582-4455-829b-080632e9c776 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:26.945957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:26.985244 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe850-6717-48c4-9f2e-561614abf72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:26.985899 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe850-6717-48c4-9f2e-561614abf72c None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:26.986173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe850-6717-48c4-9f2e-561614abf72c None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:26.986440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe850-6717-48c4-9f2e-561614abf72c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:26.997346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fe850-6717-48c4-9f2e-561614abf72c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-de3fe850-6717-48c4-9f2e-561614abf72c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:49:27.003031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:49:27.004100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:49:27.005490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:49:27.005490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:49:27.005490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:49:27.005490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:49:27.005490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:49:27.005490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:49:27.005490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:49:27.005490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:49:27.005490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:49:27.005490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:49:27.005490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:49:27.005490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:49:27.005490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 452/893] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:49:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:49:27.011174 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276e109-c591-4dfd-9ba4-c631fb5b5737 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:27.013340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:27.110754 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276e109-c591-4dfd-9ba4-c631fb5b5737 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:27.145297 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428787d-159c-4476-ae4a-97111c74b54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:27.145949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428787d-159c-4476-ae4a-97111c74b54c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:27.146226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428787d-159c-4476-ae4a-97111c74b54c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:27.146499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428787d-159c-4476-ae4a-97111c74b54c None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:27.147184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428787d-159c-4476-ae4a-97111c74b54c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:27.147485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428787d-159c-4476-ae4a-97111c74b54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:27.148860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428787d-159c-4476-ae4a-97111c74b54c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:27.157241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 442/894] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:49:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:27.163749 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe850-6717-48c4-9f2e-561614abf72c None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:27.270117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe850-6717-48c4-9f2e-561614abf72c None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:27.305564 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002d434-040f-4a6a-ba64-27ece7f0c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:27.306182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002d434-040f-4a6a-ba64-27ece7f0c185 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:27.306457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002d434-040f-4a6a-ba64-27ece7f0c185 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:27.306730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002d434-040f-4a6a-ba64-27ece7f0c185 None admin] PATH_INFO: `/v3/users/3ce00a246ba54b8381a3c956e5de3aab` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:27.322495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002d434-040f-4a6a-ba64-27ece7f0c185 None admin] RBAC: Authorizing `identity:get_user(user_id=3ce00a246ba54b8381a3c956e5de3aab)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:27.323926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002d434-040f-4a6a-ba64-27ece7f0c185 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:27.325583 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 453/895] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:49:27 2022] GET /identity/v3/users/3ce00a246ba54b8381a3c956e5de3aab => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:27.331437 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428787d-159c-4476-ae4a-97111c74b54c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:27.393562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:27.431845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428787d-159c-4476-ae4a-97111c74b54c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:27.465389 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60434afe-76e4-4a92-b135-fcf839c87863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:27.466026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60434afe-76e4-4a92-b135-fcf839c87863 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:27.466609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60434afe-76e4-4a92-b135-fcf839c87863 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:27.466882 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60434afe-76e4-4a92-b135-fcf839c87863 None admin] PATH_INFO: `/v3/projects/33911e3f82d44c1488b40d5a0d3d9265` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:27.467978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60434afe-76e4-4a92-b135-fcf839c87863 None admin] RBAC: Authorizing `identity:get_project(project_id=33911e3f82d44c1488b40d5a0d3d9265)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:27.469411 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60434afe-76e4-4a92-b135-fcf839c87863 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:27.471016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 443/896] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:49:27 2022] GET /identity/v3/projects/33911e3f82d44c1488b40d5a0d3d9265 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:27.478245 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002d434-040f-4a6a-ba64-27ece7f0c185 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:27.500555 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:27.575775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002d434-040f-4a6a-ba64-27ece7f0c185 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:27.609123 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2066721-609b-45da-aa9e-f4f72ce0cc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:27.609795 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2066721-609b-45da-aa9e-f4f72ce0cc62 None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:27.610070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2066721-609b-45da-aa9e-f4f72ce0cc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:27.610338 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2066721-609b-45da-aa9e-f4f72ce0cc62 None admin] PATH_INFO: `/v3/projects/33911e3f82d44c1488b40d5a0d3d9265/users/3ce00a246ba54b8381a3c956e5de3aab/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:27.612190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2066721-609b-45da-aa9e-f4f72ce0cc62 None admin] RBAC: Authorizing `identity:create_grant(project_id=33911e3f82d44c1488b40d5a0d3d9265, user_id=3ce00a246ba54b8381a3c956e5de3aab, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:27.613622 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2066721-609b-45da-aa9e-f4f72ce0cc62 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:27.685089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 454/897] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:49:27 2022] PUT /identity/v3/projects/33911e3f82d44c1488b40d5a0d3d9265/users/3ce00a246ba54b8381a3c956e5de3aab/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:49:29.799344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c38d36-ddef-4594-ab1e-b97930ffd2c2 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:29.799906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c38d36-ddef-4594-ab1e-b97930ffd2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:29.799906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c38d36-ddef-4594-ab1e-b97930ffd2c2 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:29.801850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 444/898] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:49:29.807691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2cde9-60c9-4756-a7a7-70860b1b799b None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:29.808125 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2cde9-60c9-4756-a7a7-70860b1b799b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:29.808259 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2cde9-60c9-4756-a7a7-70860b1b799b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:29.826518 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-65e2cde9-60c9-4756-a7a7-70860b1b799b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:49:29.827694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-65e2cde9-60c9-4756-a7a7-70860b1b799b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:49:29.892050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 455/899] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:49:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:49:30.165751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c38d36-ddef-4594-ab1e-b97930ffd2c2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:30.262295 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c38d36-ddef-4594-ab1e-b97930ffd2c2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:30.289972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:30.294613 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69571602-10e4-43cf-bb48-48180a4e6170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:30.295276 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69571602-10e4-43cf-bb48-48180a4e6170 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:30.301165 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69571602-10e4-43cf-bb48-48180a4e6170 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:30.301165 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69571602-10e4-43cf-bb48-48180a4e6170 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:30.307224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69571602-10e4-43cf-bb48-48180a4e6170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-69571602-10e4-43cf-bb48-48180a4e6170 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:49:30.311960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:49:30.313064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:49:30.314124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:49:30.314124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:49:30.314124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:49:30.314124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:49:30.314124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:49:30.314124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:49:30.314124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:49:30.314124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:49:30.314124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:49:30.314124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:49:30.314124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:49:30.314124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:49:30.314124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 445/900] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:49:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:49:30.319609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2cde9-60c9-4756-a7a7-70860b1b799b None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:30.330898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:30.416472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2cde9-60c9-4756-a7a7-70860b1b799b None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:30.448414 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d912a-ce79-4f11-b375-1fac6dbd0d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:30.448999 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d912a-ce79-4f11-b375-1fac6dbd0d48 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:30.449276 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d912a-ce79-4f11-b375-1fac6dbd0d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:30.449572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d912a-ce79-4f11-b375-1fac6dbd0d48 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:30.450220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d912a-ce79-4f11-b375-1fac6dbd0d48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:30.450516 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d912a-ce79-4f11-b375-1fac6dbd0d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:30.451864 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d912a-ce79-4f11-b375-1fac6dbd0d48 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:30.460349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 456/901] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:49:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:30.466280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69571602-10e4-43cf-bb48-48180a4e6170 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:30.562197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69571602-10e4-43cf-bb48-48180a4e6170 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:30.594493 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e1a36-ab23-4fa1-9887-2011bb4ac01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:30.595100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e1a36-ab23-4fa1-9887-2011bb4ac01a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:30.595376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e1a36-ab23-4fa1-9887-2011bb4ac01a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:30.595645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e1a36-ab23-4fa1-9887-2011bb4ac01a None admin] PATH_INFO: `/v3/users/3ce00a246ba54b8381a3c956e5de3aab` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:30.596742 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e1a36-ab23-4fa1-9887-2011bb4ac01a None admin] RBAC: Authorizing `identity:get_user(user_id=3ce00a246ba54b8381a3c956e5de3aab)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:30.598773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e1a36-ab23-4fa1-9887-2011bb4ac01a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:30.600306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 446/902] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Oct 31 14:49:30 2022] GET /identity/v3/users/3ce00a246ba54b8381a3c956e5de3aab => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:30.606105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d912a-ce79-4f11-b375-1fac6dbd0d48 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:30.674208 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:30.704807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d912a-ce79-4f11-b375-1fac6dbd0d48 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:30.737444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884ca78-154d-4017-86e7-5388842314fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:30.738031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884ca78-154d-4017-86e7-5388842314fc None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:30.738301 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884ca78-154d-4017-86e7-5388842314fc None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:30.738565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884ca78-154d-4017-86e7-5388842314fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:30.802483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884ca78-154d-4017-86e7-5388842314fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:30.803891 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884ca78-154d-4017-86e7-5388842314fc None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:30.868092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:30.898737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 457/903] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:49:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 14:49:30.903922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e1a36-ab23-4fa1-9887-2011bb4ac01a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:30.960551 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:30.999594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e1a36-ab23-4fa1-9887-2011bb4ac01a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:31.032782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e6cbd-d099-449a-820b-4464d6c8cfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:31.033426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e6cbd-d099-449a-820b-4464d6c8cfaa None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:31.033705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e6cbd-d099-449a-820b-4464d6c8cfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:31.033974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e6cbd-d099-449a-820b-4464d6c8cfaa None admin] PATH_INFO: `/v3/projects/33911e3f82d44c1488b40d5a0d3d9265` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:31.035105 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e6cbd-d099-449a-820b-4464d6c8cfaa None admin] RBAC: Authorizing `identity:get_project(project_id=33911e3f82d44c1488b40d5a0d3d9265)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:31.036662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e6cbd-d099-449a-820b-4464d6c8cfaa None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:31.038313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 447/904] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Oct 31 14:49:30 2022] GET /identity/v3/projects/33911e3f82d44c1488b40d5a0d3d9265 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:31.044510 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884ca78-154d-4017-86e7-5388842314fc None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:49:31.141909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884ca78-154d-4017-86e7-5388842314fc None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:49:31.174533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fe494-f5a8-4ec9-b5df-64476441338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:49:31.175112 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe494-f5a8-4ec9-b5df-64476441338d None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:49:31.175383 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe494-f5a8-4ec9-b5df-64476441338d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:49:31.175645 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fe494-f5a8-4ec9-b5df-64476441338d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:49:31.176899 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fe494-f5a8-4ec9-b5df-64476441338d None admin] RBAC: Adding query filter params (role.id=c62ffefc63e74a1280bef2b6a22202ad, scope.project.id=33911e3f82d44c1488b40d5a0d3d9265, user.id=3ce00a246ba54b8381a3c956e5de3aab) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:49:31.177201 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fe494-f5a8-4ec9-b5df-64476441338d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:49:31.178634 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651fe494-f5a8-4ec9-b5df-64476441338d None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:49:31.184122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 458/905] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:49:31 2022] GET /identity/v3/role_assignments?user.id=3ce00a246ba54b8381a3c956e5de3aab&scope.project.id=33911e3f82d44c1488b40d5a0d3d9265&role.id=c62ffefc63e74a1280bef2b6a22202ad => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:49:41.028409 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=36 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:49:41.181641 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=82 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:50.571627 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3a2b7-c287-4f4e-a565-b10ae2936650 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:50.572215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3a2b7-c287-4f4e-a565-b10ae2936650 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:50.572215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3a2b7-c287-4f4e-a565-b10ae2936650 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:50.573560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 448/906] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:50:50.578811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be1881-25bb-4055-a692-6fe76379fff0 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:50.579241 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be1881-25bb-4055-a692-6fe76379fff0 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:50.579340 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be1881-25bb-4055-a692-6fe76379fff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:50.597791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d8be1881-25bb-4055-a692-6fe76379fff0 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:50.599002 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d8be1881-25bb-4055-a692-6fe76379fff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:50.664338 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 459/907] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:50:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:50:50.943698 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3a2b7-c287-4f4e-a565-b10ae2936650 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:51.046549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3a2b7-c287-4f4e-a565-b10ae2936650 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:51.081858 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ff241-e49d-4c96-8c84-3e3d0723c2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:51.082509 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ff241-e49d-4c96-8c84-3e3d0723c2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:51.082816 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ff241-e49d-4c96-8c84-3e3d0723c2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:51.083090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ff241-e49d-4c96-8c84-3e3d0723c2b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:51.093756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ff241-e49d-4c96-8c84-3e3d0723c2b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:51.104917 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ff241-e49d-4c96-8c84-3e3d0723c2b0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2c9ff241-e49d-4c96-8c84-3e3d0723c2b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:50:51.110289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:50:51.111507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:50:51.113264 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:50:51.113264 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:50:51.113264 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:50:51.113264 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 449/908] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:50:51.118385 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be1881-25bb-4055-a692-6fe76379fff0 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:51.214488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be1881-25bb-4055-a692-6fe76379fff0 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:51.242672 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:51.248233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667410b-0521-4f39-b026-1e5e975c5f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:51.248819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667410b-0521-4f39-b026-1e5e975c5f54 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:51.249092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667410b-0521-4f39-b026-1e5e975c5f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:51.249386 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667410b-0521-4f39-b026-1e5e975c5f54 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:51.250014 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667410b-0521-4f39-b026-1e5e975c5f54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:51.250307 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667410b-0521-4f39-b026-1e5e975c5f54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:51.251647 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667410b-0521-4f39-b026-1e5e975c5f54 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:51.262755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 460/909] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:50:51.268613 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ff241-e49d-4c96-8c84-3e3d0723c2b0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:51.323284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:51.372815 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ff241-e49d-4c96-8c84-3e3d0723c2b0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:51.407006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a219e-6384-4106-8935-4a71014e47fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:51.407598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a219e-6384-4106-8935-4a71014e47fa None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:51.407872 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a219e-6384-4106-8935-4a71014e47fa None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:51.408407 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a219e-6384-4106-8935-4a71014e47fa None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:51.409625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a219e-6384-4106-8935-4a71014e47fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:51.411038 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a219e-6384-4106-8935-4a71014e47fa None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:51.566063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 450/910] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Oct 31 14:50:51 2022] POST /identity/v3/users => generated 251 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:50:53.737854 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3504-9f7e-409d-98a3-7fa88d3d7739 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:53.738462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3504-9f7e-409d-98a3-7fa88d3d7739 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:53.738565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e3504-9f7e-409d-98a3-7fa88d3d7739 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:53.739832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 461/911] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:50:53.744928 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37e4d-d527-41ba-bdc6-eb2933303e38 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:53.747307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37e4d-d527-41ba-bdc6-eb2933303e38 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:53.747307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37e4d-d527-41ba-bdc6-eb2933303e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:53.763968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f9a37e4d-d527-41ba-bdc6-eb2933303e38 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:53.765214 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f9a37e4d-d527-41ba-bdc6-eb2933303e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:53.831704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 451/912] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:50:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:50:54.112147 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e3504-9f7e-409d-98a3-7fa88d3d7739 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:54.212986 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e3504-9f7e-409d-98a3-7fa88d3d7739 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:54.247756 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd707cf9-6366-49d5-bd94-858569d41269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:54.248371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd707cf9-6366-49d5-bd94-858569d41269 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:54.248648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd707cf9-6366-49d5-bd94-858569d41269 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:54.248914 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd707cf9-6366-49d5-bd94-858569d41269 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:54.261149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd707cf9-6366-49d5-bd94-858569d41269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-cd707cf9-6366-49d5-bd94-858569d41269 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:50:54.265907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:50:54.267010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:50:54.268675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:50:54.268675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:50:54.268675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:50:54.268675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:50:54.268675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:50:54.268675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:50:54.268675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:50:54.268675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:50:54.268675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:50:54.268675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:50:54.268675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:50:54.268675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:50:54.268675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 462/913] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:50:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:50:54.274196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a37e4d-d527-41ba-bdc6-eb2933303e38 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:54.312626 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:54.370381 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a37e4d-d527-41ba-bdc6-eb2933303e38 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:54.402763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcbdd3-5037-4009-9bd6-f73ce142ae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:54.403345 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcbdd3-5037-4009-9bd6-f73ce142ae86 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:54.403618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcbdd3-5037-4009-9bd6-f73ce142ae86 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:54.403882 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcbdd3-5037-4009-9bd6-f73ce142ae86 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:54.404541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcbdd3-5037-4009-9bd6-f73ce142ae86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:54.404872 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcbdd3-5037-4009-9bd6-f73ce142ae86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:54.406251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dcbdd3-5037-4009-9bd6-f73ce142ae86 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:54.415038 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 452/914] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:50:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:50:54.420932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd707cf9-6366-49d5-bd94-858569d41269 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:54.469649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:54.517331 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd707cf9-6366-49d5-bd94-858569d41269 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:54.550377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23614fda-b421-45ef-b1b0-e9cc226b8f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:54.551000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23614fda-b421-45ef-b1b0-e9cc226b8f7e None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:54.551272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23614fda-b421-45ef-b1b0-e9cc226b8f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:54.551538 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23614fda-b421-45ef-b1b0-e9cc226b8f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:54.563173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23614fda-b421-45ef-b1b0-e9cc226b8f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:54.565218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23614fda-b421-45ef-b1b0-e9cc226b8f7e None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-23614fda-b421-45ef-b1b0-e9cc226b8f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:50:54.579005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:50:54.580065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:50:54.581074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:50:54.581074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:50:54.581074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:50:54.581074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 463/915] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:50:54.586190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcbdd3-5037-4009-9bd6-f73ce142ae86 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:54.681175 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:54.683956 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcbdd3-5037-4009-9bd6-f73ce142ae86 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:54.716274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720230-f4fd-4c84-adcd-22d4086bc153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:54.716860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720230-f4fd-4c84-adcd-22d4086bc153 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:54.717133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720230-f4fd-4c84-adcd-22d4086bc153 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:54.717433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720230-f4fd-4c84-adcd-22d4086bc153 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:54.718066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5720230-f4fd-4c84-adcd-22d4086bc153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:54.718385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5720230-f4fd-4c84-adcd-22d4086bc153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:54.719756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5720230-f4fd-4c84-adcd-22d4086bc153 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:54.731670 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 453/916] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 14:50:54.738208 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23614fda-b421-45ef-b1b0-e9cc226b8f7e None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:54.836225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23614fda-b421-45ef-b1b0-e9cc226b8f7e None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:54.837803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:54.868695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c90c57-59cc-4909-907c-3110aa150998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:54.869333 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c90c57-59cc-4909-907c-3110aa150998 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:54.869614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c90c57-59cc-4909-907c-3110aa150998 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:54.869883 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c90c57-59cc-4909-907c-3110aa150998 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:54.876939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c90c57-59cc-4909-907c-3110aa150998 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:54.879557 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c90c57-59cc-4909-907c-3110aa150998 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-f7c90c57-59cc-4909-907c-3110aa150998 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:50:54.889759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:50:54.890867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:50:54.891803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:50:54.891803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:50:54.891803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:50:54.891803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:50:54.891803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:50:54.891803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:50:54.891803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:50:54.891803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:50:54.891803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 14:50:54.891803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:50:54.891803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 464/917] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:50:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:50:54.896922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720230-f4fd-4c84-adcd-22d4086bc153 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:54.994056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720230-f4fd-4c84-adcd-22d4086bc153 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:55.028101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837bee2-dbb5-4185-abb3-4e6aaf602f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:55.028692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837bee2-dbb5-4185-abb3-4e6aaf602f10 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:55.028968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837bee2-dbb5-4185-abb3-4e6aaf602f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:55.029242 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837bee2-dbb5-4185-abb3-4e6aaf602f10 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:55.029984 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837bee2-dbb5-4185-abb3-4e6aaf602f10 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:55.030281 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837bee2-dbb5-4185-abb3-4e6aaf602f10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:55.031689 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837bee2-dbb5-4185-abb3-4e6aaf602f10 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:55.050482 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 454/918] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Oct 31 14:50:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:50:55.056339 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c90c57-59cc-4909-907c-3110aa150998 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:55.159797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c90c57-59cc-4909-907c-3110aa150998 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:55.192138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ece1e5-566f-489d-9126-8e6d42096111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:55.192769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ece1e5-566f-489d-9126-8e6d42096111 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:55.193025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ece1e5-566f-489d-9126-8e6d42096111 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:55.193306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ece1e5-566f-489d-9126-8e6d42096111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:55.203391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ece1e5-566f-489d-9126-8e6d42096111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:55.204810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ece1e5-566f-489d-9126-8e6d42096111 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-30ece1e5-566f-489d-9126-8e6d42096111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:50:55.218989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:50:55.220063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:50:55.221830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:50:55.221830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:50:55.221830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:50:55.221830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 465/919] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:50:55.226373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837bee2-dbb5-4185-abb3-4e6aaf602f10 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:55.244824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:55.322887 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837bee2-dbb5-4185-abb3-4e6aaf602f10 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:55.355567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fca22-324c-4f51-ab8b-0cb3d397ec0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:55.356180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fca22-324c-4f51-ab8b-0cb3d397ec0b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:55.356455 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fca22-324c-4f51-ab8b-0cb3d397ec0b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:55.356722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fca22-324c-4f51-ab8b-0cb3d397ec0b None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:55.357373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fca22-324c-4f51-ab8b-0cb3d397ec0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:55.357672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fca22-324c-4f51-ab8b-0cb3d397ec0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:55.359010 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fca22-324c-4f51-ab8b-0cb3d397ec0b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:55.369647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 455/920] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:50:55.375351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ece1e5-566f-489d-9126-8e6d42096111 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:55.390983 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:55.473698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ece1e5-566f-489d-9126-8e6d42096111 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:55.507168 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38596dbd-2d6e-4148-a4e8-9cda2c6a4a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:55.507711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38596dbd-2d6e-4148-a4e8-9cda2c6a4a4b None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:55.507982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38596dbd-2d6e-4148-a4e8-9cda2c6a4a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:55.508244 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38596dbd-2d6e-4148-a4e8-9cda2c6a4a4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:55.514528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38596dbd-2d6e-4148-a4e8-9cda2c6a4a4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:55.515949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38596dbd-2d6e-4148-a4e8-9cda2c6a4a4b None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-38596dbd-2d6e-4148-a4e8-9cda2c6a4a4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:50:55.526927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:50:55.528596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:50:55.530650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:50:55.530650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:50:55.530650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:50:55.530650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:50:55.530650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:50:55.530650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:50:55.530650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:50:55.530650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:50:55.530650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 466/921] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:50:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:50:55.536166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fca22-324c-4f51-ab8b-0cb3d397ec0b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:55.611362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:55.632170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fca22-324c-4f51-ab8b-0cb3d397ec0b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:55.664521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d91c-1fdf-4ed3-9d41-a4b2d03ab3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:55.665113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d91c-1fdf-4ed3-9d41-a4b2d03ab3cd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:55.665417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d91c-1fdf-4ed3-9d41-a4b2d03ab3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:55.665687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d91c-1fdf-4ed3-9d41-a4b2d03ab3cd None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:55.666366 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d91c-1fdf-4ed3-9d41-a4b2d03ab3cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:55.666664 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d91c-1fdf-4ed3-9d41-a4b2d03ab3cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:55.668204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d91c-1fdf-4ed3-9d41-a4b2d03ab3cd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:55.680991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 456/922] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:50:55.686973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38596dbd-2d6e-4148-a4e8-9cda2c6a4a4b None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:55.758718 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:55.782493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38596dbd-2d6e-4148-a4e8-9cda2c6a4a4b None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:55.816121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b3a69-0bd1-4575-8335-877de8ae2ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:55.816839 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b3a69-0bd1-4575-8335-877de8ae2ce9 None admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:55.817111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b3a69-0bd1-4575-8335-877de8ae2ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:55.817403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b3a69-0bd1-4575-8335-877de8ae2ce9 None admin] PATH_INFO: `/v3/projects/b82a0373e3b649f3a023efd8db204123/users/77b43d235d0441b3b8a272d051b54ce3/roles/bc1117423b4841a4ae3e7be8f54af3b7` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:55.831902 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b3a69-0bd1-4575-8335-877de8ae2ce9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b82a0373e3b649f3a023efd8db204123, user_id=77b43d235d0441b3b8a272d051b54ce3, role_id=bc1117423b4841a4ae3e7be8f54af3b7)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:55.833377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b3a69-0bd1-4575-8335-877de8ae2ce9 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:55.983852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 467/923] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:50:55 2022] PUT /identity/v3/projects/b82a0373e3b649f3a023efd8db204123/users/77b43d235d0441b3b8a272d051b54ce3/roles/bc1117423b4841a4ae3e7be8f54af3b7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 14:50:58.098312 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7bca6-d3be-4d90-99ab-7d0e73e8dff4 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:58.098856 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7bca6-d3be-4d90-99ab-7d0e73e8dff4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:58.098856 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7bca6-d3be-4d90-99ab-7d0e73e8dff4 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:58.100150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 457/924] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:50:58.105336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4d02f-b46e-4deb-8250-f47eac968ee4 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:58.105756 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4d02f-b46e-4deb-8250-f47eac968ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:58.105862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4d02f-b46e-4deb-8250-f47eac968ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:58.124238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e5f4d02f-b46e-4deb-8250-f47eac968ee4 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:50:58.125434 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e5f4d02f-b46e-4deb-8250-f47eac968ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:50:58.191173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 468/925] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:50:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:50:58.457843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7bca6-d3be-4d90-99ab-7d0e73e8dff4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:58.555702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7bca6-d3be-4d90-99ab-7d0e73e8dff4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:58.588684 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16df40-7f26-4e48-a582-2005affc80a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:58.589317 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16df40-7f26-4e48-a582-2005affc80a6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:58.589595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16df40-7f26-4e48-a582-2005affc80a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:58.589859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16df40-7f26-4e48-a582-2005affc80a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:58.596377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:58.599982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16df40-7f26-4e48-a582-2005affc80a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-4b16df40-7f26-4e48-a582-2005affc80a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:50:58.604760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:50:58.605866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:50:58.606910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:50:58.606910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:50:58.606910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:50:58.606910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:50:58.606910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:50:58.606910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:50:58.606910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:50:58.606910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:50:58.606910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:50:58.606910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:50:58.606910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 31 14:50:58.606910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:50:58.606910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 458/926] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Oct 31 14:50:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:50:58.611993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4d02f-b46e-4deb-8250-f47eac968ee4 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:58.665791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:58.709391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4d02f-b46e-4deb-8250-f47eac968ee4 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:58.740737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd932-ec0a-4e29-84e3-08662f6aca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:58.741343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd932-ec0a-4e29-84e3-08662f6aca73 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:58.741618 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd932-ec0a-4e29-84e3-08662f6aca73 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:58.741881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd932-ec0a-4e29-84e3-08662f6aca73 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:58.742525 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cd932-ec0a-4e29-84e3-08662f6aca73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:58.742820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cd932-ec0a-4e29-84e3-08662f6aca73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:58.744166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cd932-ec0a-4e29-84e3-08662f6aca73 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:58.751639 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 469/927] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Oct 31 14:50:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:50:58.758164 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16df40-7f26-4e48-a582-2005affc80a6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:58.855562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16df40-7f26-4e48-a582-2005affc80a6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:58.889645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968477d8-2645-4480-9cc4-1dca98e8a5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:58.890344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968477d8-2645-4480-9cc4-1dca98e8a5ed None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:58.890615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968477d8-2645-4480-9cc4-1dca98e8a5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:58.890881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968477d8-2645-4480-9cc4-1dca98e8a5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:58.900704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968477d8-2645-4480-9cc4-1dca98e8a5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:58.902158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968477d8-2645-4480-9cc4-1dca98e8a5ed None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-968477d8-2645-4480-9cc4-1dca98e8a5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:50:58.916615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:50:58.917683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:50:58.918873 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:50:58.918873 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:50:58.918873 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:50:58.918873 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 459/928] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:50:58.923407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd932-ec0a-4e29-84e3-08662f6aca73 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:59.022402 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd932-ec0a-4e29-84e3-08662f6aca73 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:59.038113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:59.055732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5caa3e-5c22-498c-9985-9df83c3a7f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:59.056331 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5caa3e-5c22-498c-9985-9df83c3a7f48 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:59.056606 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5caa3e-5c22-498c-9985-9df83c3a7f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:59.056876 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5caa3e-5c22-498c-9985-9df83c3a7f48 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:59.057535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5caa3e-5c22-498c-9985-9df83c3a7f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:59.057834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5caa3e-5c22-498c-9985-9df83c3a7f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:59.059194 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5caa3e-5c22-498c-9985-9df83c3a7f48 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:59.071155 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 470/929] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:50:59.077136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968477d8-2645-4480-9cc4-1dca98e8a5ed None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:59.125542 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:59.173297 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968477d8-2645-4480-9cc4-1dca98e8a5ed None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:59.206298 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c02a4-58bb-402b-b195-dd1f62047083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:59.206911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c02a4-58bb-402b-b195-dd1f62047083 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:59.207185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c02a4-58bb-402b-b195-dd1f62047083 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:59.207454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c02a4-58bb-402b-b195-dd1f62047083 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:59.214570 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c02a4-58bb-402b-b195-dd1f62047083 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:59.215974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c02a4-58bb-402b-b195-dd1f62047083 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-174c02a4-58bb-402b-b195-dd1f62047083 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:50:59.227467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:50:59.228597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:50:59.229968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:50:59.229968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:50:59.229968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:50:59.229968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:50:59.229968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:50:59.229968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:50:59.229968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:50:59.229968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:50:59.229968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 14:50:59.229968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:50:59.229968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 460/930] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:50:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:50:59.234586 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5caa3e-5c22-498c-9985-9df83c3a7f48 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:59.333457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5caa3e-5c22-498c-9985-9df83c3a7f48 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:59.367522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f7dfb-5c13-4eb4-b7cf-709a2834b207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:59.368112 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f7dfb-5c13-4eb4-b7cf-709a2834b207 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:59.368385 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f7dfb-5c13-4eb4-b7cf-709a2834b207 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:59.368650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f7dfb-5c13-4eb4-b7cf-709a2834b207 None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:59.369392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f7dfb-5c13-4eb4-b7cf-709a2834b207 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:50:59.369746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f7dfb-5c13-4eb4-b7cf-709a2834b207 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:59.371156 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f7dfb-5c13-4eb4-b7cf-709a2834b207 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:59.388208 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 471/931] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Oct 31 14:50:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:50:59.394344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c02a4-58bb-402b-b195-dd1f62047083 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:59.492491 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c02a4-58bb-402b-b195-dd1f62047083 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:59.502679 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:59.524751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976b851-7776-47a0-b3ba-4b8919f79e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:59.525383 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976b851-7776-47a0-b3ba-4b8919f79e7f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:59.525679 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976b851-7776-47a0-b3ba-4b8919f79e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:59.525930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976b851-7776-47a0-b3ba-4b8919f79e7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:59.591309 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976b851-7776-47a0-b3ba-4b8919f79e7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:59.592721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976b851-7776-47a0-b3ba-4b8919f79e7f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:59.687429 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 461/932] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:50:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 14:50:59.693238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f7dfb-5c13-4eb4-b7cf-709a2834b207 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:59.729424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:59.793376 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f7dfb-5c13-4eb4-b7cf-709a2834b207 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:59.825194 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c89e7-1eac-4564-901e-0d8ef8410ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:50:59.825828 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c89e7-1eac-4564-901e-0d8ef8410ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:50:59.826105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c89e7-1eac-4564-901e-0d8ef8410ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:50:59.826369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c89e7-1eac-4564-901e-0d8ef8410ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:50:59.836684 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c89e7-1eac-4564-901e-0d8ef8410ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:50:59.838260 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c89e7-1eac-4564-901e-0d8ef8410ad4 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-ae4c89e7-1eac-4564-901e-0d8ef8410ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:50:59.852887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:50:59.854030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:50:59.855131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:50:59.855131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:50:59.855131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:50:59.855131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 472/933] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:50:59.859673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976b851-7776-47a0-b3ba-4b8919f79e7f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:50:59.872383 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:50:59.956397 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976b851-7776-47a0-b3ba-4b8919f79e7f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:50:59.989308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361689f-9104-46ef-b86c-1ef80f5f0c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:00.007284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361689f-9104-46ef-b86c-1ef80f5f0c44 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:00.007284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361689f-9104-46ef-b86c-1ef80f5f0c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:00.007284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361689f-9104-46ef-b86c-1ef80f5f0c44 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:00.007284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361689f-9104-46ef-b86c-1ef80f5f0c44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:00.007284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361689f-9104-46ef-b86c-1ef80f5f0c44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:00.007284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361689f-9104-46ef-b86c-1ef80f5f0c44 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:00.007803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 462/934] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:00.009590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c89e7-1eac-4564-901e-0d8ef8410ad4 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:00.093764 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:00.108483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c89e7-1eac-4564-901e-0d8ef8410ad4 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:00.140584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67901273-b237-4896-9ddf-1910dc6135dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:00.141196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67901273-b237-4896-9ddf-1910dc6135dc None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:00.141496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67901273-b237-4896-9ddf-1910dc6135dc None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:00.141762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67901273-b237-4896-9ddf-1910dc6135dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:00.148717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67901273-b237-4896-9ddf-1910dc6135dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:00.150175 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67901273-b237-4896-9ddf-1910dc6135dc None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-67901273-b237-4896-9ddf-1910dc6135dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:51:00.161266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:00.162314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:00.163202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:51:00.163202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:51:00.163202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:51:00.163202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:51:00.163202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:51:00.163202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:51:00.163202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:51:00.163202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:51:00.163202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 473/935] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:51:00.168348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361689f-9104-46ef-b86c-1ef80f5f0c44 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:00.235595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:00.265434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361689f-9104-46ef-b86c-1ef80f5f0c44 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:00.297721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58da39-598f-438b-934d-ba144b17dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:00.298316 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58da39-598f-438b-934d-ba144b17dc15 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:00.298594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58da39-598f-438b-934d-ba144b17dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:00.298889 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58da39-598f-438b-934d-ba144b17dc15 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:00.299568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58da39-598f-438b-934d-ba144b17dc15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:00.299867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58da39-598f-438b-934d-ba144b17dc15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:00.301271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58da39-598f-438b-934d-ba144b17dc15 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:00.312616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 463/936] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:00.319353 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67901273-b237-4896-9ddf-1910dc6135dc None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:00.417569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67901273-b237-4896-9ddf-1910dc6135dc None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:00.449771 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8ce41-8734-4ea9-8777-763ef53bdd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:00.450364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8ce41-8734-4ea9-8777-763ef53bdd05 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:00.450638 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8ce41-8734-4ea9-8777-763ef53bdd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:00.450906 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8ce41-8734-4ea9-8777-763ef53bdd05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:00.451619 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8ce41-8734-4ea9-8777-763ef53bdd05 None admin] RBAC: Adding query filter params (role.id=bc1117423b4841a4ae3e7be8f54af3b7, scope.project.id=b82a0373e3b649f3a023efd8db204123, user.id=77b43d235d0441b3b8a272d051b54ce3) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:00.451927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8ce41-8734-4ea9-8777-763ef53bdd05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:00.453363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8ce41-8734-4ea9-8777-763ef53bdd05 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:00.459494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 474/937] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:51:00 2022] GET /identity/v3/role_assignments?user.id=77b43d235d0441b3b8a272d051b54ce3&scope.project.id=b82a0373e3b649f3a023efd8db204123&role.id=bc1117423b4841a4ae3e7be8f54af3b7 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:02.620545 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d566ee3-6fc9-4ee7-b68f-948a202bbf96 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:02.621123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d566ee3-6fc9-4ee7-b68f-948a202bbf96 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:02.621123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d566ee3-6fc9-4ee7-b68f-948a202bbf96 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:02.622434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 464/938] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:51:02.628383 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af1f00-a7e7-42b0-9678-5d69eaa1f9f9 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:02.628786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af1f00-a7e7-42b0-9678-5d69eaa1f9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:02.628899 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af1f00-a7e7-42b0-9678-5d69eaa1f9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:02.646603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-48af1f00-a7e7-42b0-9678-5d69eaa1f9f9 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:02.647778 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-48af1f00-a7e7-42b0-9678-5d69eaa1f9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:02.650522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:02.712517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 475/939] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:51:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:51:02.984991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d566ee3-6fc9-4ee7-b68f-948a202bbf96 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:03.084029 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d566ee3-6fc9-4ee7-b68f-948a202bbf96 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:03.111416 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:03.116913 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dcc67-fb89-468b-b7ba-cb82fcd9b6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:03.117567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dcc67-fb89-468b-b7ba-cb82fcd9b6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:03.117843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dcc67-fb89-468b-b7ba-cb82fcd9b6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:03.118112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dcc67-fb89-468b-b7ba-cb82fcd9b6c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:03.128435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535dcc67-fb89-468b-b7ba-cb82fcd9b6c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-535dcc67-fb89-468b-b7ba-cb82fcd9b6c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:51:03.133196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:03.142380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:03.143878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:03.143878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:03.143878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:03.143878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:03.143878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:51:03.143878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:51:03.143878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:51:03.143878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:51:03.143878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:51:03.143878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:51:03.143878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:51:03.143878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:51:03.143878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 465/940] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:51:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:51:03.144633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af1f00-a7e7-42b0-9678-5d69eaa1f9f9 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:03.238869 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af1f00-a7e7-42b0-9678-5d69eaa1f9f9 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:03.272345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732690dd-bb9b-4830-a29b-896df7bc6a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:03.272941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732690dd-bb9b-4830-a29b-896df7bc6a77 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:03.273213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732690dd-bb9b-4830-a29b-896df7bc6a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:03.273519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732690dd-bb9b-4830-a29b-896df7bc6a77 None admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:03.274174 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732690dd-bb9b-4830-a29b-896df7bc6a77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:03.274470 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732690dd-bb9b-4830-a29b-896df7bc6a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:03.275825 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732690dd-bb9b-4830-a29b-896df7bc6a77 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:03.284076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 476/941] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:51:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:03.289949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dcc67-fb89-468b-b7ba-cb82fcd9b6c9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:03.387288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dcc67-fb89-468b-b7ba-cb82fcd9b6c9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:03.420962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546247c5-33de-4641-adb5-9a892659019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:03.421615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546247c5-33de-4641-adb5-9a892659019f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:03.421890 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546247c5-33de-4641-adb5-9a892659019f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:03.422159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546247c5-33de-4641-adb5-9a892659019f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:03.432951 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546247c5-33de-4641-adb5-9a892659019f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:03.434433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546247c5-33de-4641-adb5-9a892659019f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-546247c5-33de-4641-adb5-9a892659019f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:51:03.449322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:03.450341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:51:03.451286 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:51:03.451286 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:51:03.451286 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:51:03.451286 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 466/942] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:51:03.457459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732690dd-bb9b-4830-a29b-896df7bc6a77 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:03.460434 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:03.558852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732690dd-bb9b-4830-a29b-896df7bc6a77 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:03.591537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899861c-df47-4be5-8154-fa33cb083e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:03.592122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899861c-df47-4be5-8154-fa33cb083e35 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:03.592390 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899861c-df47-4be5-8154-fa33cb083e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:03.592653 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899861c-df47-4be5-8154-fa33cb083e35 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:03.593274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899861c-df47-4be5-8154-fa33cb083e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:03.593595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899861c-df47-4be5-8154-fa33cb083e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:03.594942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899861c-df47-4be5-8154-fa33cb083e35 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:03.606824 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 477/943] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:03.612812 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546247c5-33de-4641-adb5-9a892659019f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:03.655786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:03.709480 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546247c5-33de-4641-adb5-9a892659019f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:03.741524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a16e7-335b-466f-af67-9e86022d9eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:03.742178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a16e7-335b-466f-af67-9e86022d9eca None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:03.742449 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a16e7-335b-466f-af67-9e86022d9eca None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:03.742712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a16e7-335b-466f-af67-9e86022d9eca None admin] PATH_INFO: `/v3/users/placement` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:03.749971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a16e7-335b-466f-af67-9e86022d9eca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:03.751409 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a16e7-335b-466f-af67-9e86022d9eca None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-fd5a16e7-335b-466f-af67-9e86022d9eca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:51:03.763277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:03.767110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:03.769092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:03.769092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:03.769092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:51:03.769092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:51:03.769092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:51:03.769092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:51:03.769092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:51:03.769092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:51:03.769092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 14:51:03.769092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:51:03.769092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 467/944] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:51:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:51:03.771028 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899861c-df47-4be5-8154-fa33cb083e35 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:03.831719 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:03.868326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899861c-df47-4be5-8154-fa33cb083e35 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:03.902289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4854c3b-0191-411e-8c1e-a55c50f9c56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:03.902879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4854c3b-0191-411e-8c1e-a55c50f9c56d None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:03.903151 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4854c3b-0191-411e-8c1e-a55c50f9c56d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:03.906412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4854c3b-0191-411e-8c1e-a55c50f9c56d None admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:03.906412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4854c3b-0191-411e-8c1e-a55c50f9c56d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:03.906412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4854c3b-0191-411e-8c1e-a55c50f9c56d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:03.906412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4854c3b-0191-411e-8c1e-a55c50f9c56d None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:03.922307 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 478/945] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Oct 31 14:51:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:03.928140 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a16e7-335b-466f-af67-9e86022d9eca None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:04.027830 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a16e7-335b-466f-af67-9e86022d9eca None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:04.029342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:04.059916 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c43aa9-12ba-4c98-80ae-d7ab6f3e474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:04.060532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c43aa9-12ba-4c98-80ae-d7ab6f3e474b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:04.060808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c43aa9-12ba-4c98-80ae-d7ab6f3e474b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:04.061079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c43aa9-12ba-4c98-80ae-d7ab6f3e474b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:04.071651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c43aa9-12ba-4c98-80ae-d7ab6f3e474b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:04.073066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c43aa9-12ba-4c98-80ae-d7ab6f3e474b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-02c43aa9-12ba-4c98-80ae-d7ab6f3e474b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:51:04.090027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:04.090931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:51:04.091800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:51:04.091800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:51:04.091800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:51:04.091800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 468/946] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 31 14:51:04.094081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4854c3b-0191-411e-8c1e-a55c50f9c56d None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:04.192821 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4854c3b-0191-411e-8c1e-a55c50f9c56d None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:04.211957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:04.226008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57b08b-cffe-423d-8e67-95f9c6f42b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:04.226603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57b08b-cffe-423d-8e67-95f9c6f42b30 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:04.226880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57b08b-cffe-423d-8e67-95f9c6f42b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:04.227181 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57b08b-cffe-423d-8e67-95f9c6f42b30 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:04.227810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57b08b-cffe-423d-8e67-95f9c6f42b30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:04.228110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57b08b-cffe-423d-8e67-95f9c6f42b30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:04.229493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57b08b-cffe-423d-8e67-95f9c6f42b30 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:04.241226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 479/947] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:04.247240 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c43aa9-12ba-4c98-80ae-d7ab6f3e474b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:04.344543 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c43aa9-12ba-4c98-80ae-d7ab6f3e474b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:04.378192 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b389c-3a51-4c95-8c69-40ebe02d9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:04.378798 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b389c-3a51-4c95-8c69-40ebe02d9744 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:04.379071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b389c-3a51-4c95-8c69-40ebe02d9744 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:04.379336 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b389c-3a51-4c95-8c69-40ebe02d9744 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:04.385722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b389c-3a51-4c95-8c69-40ebe02d9744 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:04.387183 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b389c-3a51-4c95-8c69-40ebe02d9744 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-ac7b389c-3a51-4c95-8c69-40ebe02d9744 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:51:04.398688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:04.399707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:04.400908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:51:04.400908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:51:04.400908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:51:04.400908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:51:04.400908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:51:04.400908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:51:04.400908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:51:04.400908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:51:04.400908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 469/948] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:51:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:51:04.405607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57b08b-cffe-423d-8e67-95f9c6f42b30 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:04.504593 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57b08b-cffe-423d-8e67-95f9c6f42b30 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:04.537248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d73378-4079-4535-a45c-e8e6e3a7b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:04.537867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d73378-4079-4535-a45c-e8e6e3a7b84d None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:04.538139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d73378-4079-4535-a45c-e8e6e3a7b84d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:04.538404 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d73378-4079-4535-a45c-e8e6e3a7b84d None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:04.539076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d73378-4079-4535-a45c-e8e6e3a7b84d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:04.539374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d73378-4079-4535-a45c-e8e6e3a7b84d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:04.540785 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d73378-4079-4535-a45c-e8e6e3a7b84d None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:04.552320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 480/949] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:51:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:04.558345 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b389c-3a51-4c95-8c69-40ebe02d9744 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:04.575013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:04.656127 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b389c-3a51-4c95-8c69-40ebe02d9744 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:04.688719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8939ae-1d33-448e-b81c-8bd69076df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:04.689905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8939ae-1d33-448e-b81c-8bd69076df8e None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:04.690183 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8939ae-1d33-448e-b81c-8bd69076df8e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:04.690452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8939ae-1d33-448e-b81c-8bd69076df8e None admin] PATH_INFO: `/v3/projects/b82a0373e3b649f3a023efd8db204123/users/77b43d235d0441b3b8a272d051b54ce3/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:04.692294 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8939ae-1d33-448e-b81c-8bd69076df8e None admin] RBAC: Authorizing `identity:create_grant(project_id=b82a0373e3b649f3a023efd8db204123, user_id=77b43d235d0441b3b8a272d051b54ce3, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:04.693727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8939ae-1d33-448e-b81c-8bd69076df8e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:04.799170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 470/950] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Oct 31 14:51:04 2022] PUT /identity/v3/projects/b82a0373e3b649f3a023efd8db204123/users/77b43d235d0441b3b8a272d051b54ce3/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 14:51:06.939923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e1a0e-59e8-4707-9b13-81ac3406deb1 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:06.940567 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e1a0e-59e8-4707-9b13-81ac3406deb1 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:06.940567 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e1a0e-59e8-4707-9b13-81ac3406deb1 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:06.941950 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 481/951] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:51:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:51:06.947115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b9410-21b9-49dd-9a84-8b22e85bb538 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:06.947495 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b9410-21b9-49dd-9a84-8b22e85bb538 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:06.947662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b9410-21b9-49dd-9a84-8b22e85bb538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:06.966287 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3a5b9410-21b9-49dd-9a84-8b22e85bb538 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:06.967459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3a5b9410-21b9-49dd-9a84-8b22e85bb538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:07.037019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 471/952] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:51:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:51:07.299775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e1a0e-59e8-4707-9b13-81ac3406deb1 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:07.342396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:07.398759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e1a0e-59e8-4707-9b13-81ac3406deb1 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:07.431309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e5b3f-5b0d-458c-8873-8e03d5805ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:07.431925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e5b3f-5b0d-458c-8873-8e03d5805ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:07.432193 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e5b3f-5b0d-458c-8873-8e03d5805ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:07.432456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e5b3f-5b0d-458c-8873-8e03d5805ae6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:07.442729 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e5b3f-5b0d-458c-8873-8e03d5805ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-db1e5b3f-5b0d-458c-8873-8e03d5805ae6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 31 14:51:07.447407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:07.448581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:07.449826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:07.449826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:07.449826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:07.449826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:07.449826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 31 14:51:07.449826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 31 14:51:07.449826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 31 14:51:07.449826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 31 14:51:07.449826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 31 14:51:07.449826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 31 14:51:07.449826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 31 14:51:07.449826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:51:07.449826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 482/953] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Oct 31 14:51:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:51:07.454450 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b9410-21b9-49dd-9a84-8b22e85bb538 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:07.458135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:07.551195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b9410-21b9-49dd-9a84-8b22e85bb538 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:07.583578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176a9c-45d9-4690-a990-8570c5d2d462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:07.584173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176a9c-45d9-4690-a990-8570c5d2d462 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:07.584449 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176a9c-45d9-4690-a990-8570c5d2d462 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:07.584719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a176a9c-45d9-4690-a990-8570c5d2d462 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:07.585398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176a9c-45d9-4690-a990-8570c5d2d462 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:07.585698 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176a9c-45d9-4690-a990-8570c5d2d462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:07.587046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a176a9c-45d9-4690-a990-8570c5d2d462 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:07.595778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 472/954] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Oct 31 14:51:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:07.601890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e5b3f-5b0d-458c-8873-8e03d5805ae6 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:07.696782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:07.699472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e5b3f-5b0d-458c-8873-8e03d5805ae6 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:07.731681 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225f6cf-0696-4d4f-9c07-d559312b0c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:07.732289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225f6cf-0696-4d4f-9c07-d559312b0c5d None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:07.732569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225f6cf-0696-4d4f-9c07-d559312b0c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:07.732833 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225f6cf-0696-4d4f-9c07-d559312b0c5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:07.742967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225f6cf-0696-4d4f-9c07-d559312b0c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:07.744407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225f6cf-0696-4d4f-9c07-d559312b0c5d None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-4225f6cf-0696-4d4f-9c07-d559312b0c5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:51:07.758694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:07.760554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:51:07.761703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:51:07.761703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:51:07.761703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:51:07.761703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 483/955] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:51:07.765610 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176a9c-45d9-4690-a990-8570c5d2d462 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:07.830107 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:07.863250 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a176a9c-45d9-4690-a990-8570c5d2d462 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:07.894790 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a1dd6-793e-4cd9-b7dd-0dd8a044a91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:07.895381 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a1dd6-793e-4cd9-b7dd-0dd8a044a91b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:07.895656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a1dd6-793e-4cd9-b7dd-0dd8a044a91b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:07.895922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a1dd6-793e-4cd9-b7dd-0dd8a044a91b None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:07.896548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a1dd6-793e-4cd9-b7dd-0dd8a044a91b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:07.896843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a1dd6-793e-4cd9-b7dd-0dd8a044a91b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:07.898207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a1dd6-793e-4cd9-b7dd-0dd8a044a91b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:07.909627 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 473/956] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:07.915501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225f6cf-0696-4d4f-9c07-d559312b0c5d None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:08.014823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225f6cf-0696-4d4f-9c07-d559312b0c5d None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:08.047952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabf509-28ef-4ee0-98a8-26981f11255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:08.049122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabf509-28ef-4ee0-98a8-26981f11255d None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:08.049498 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabf509-28ef-4ee0-98a8-26981f11255d None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:08.049768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabf509-28ef-4ee0-98a8-26981f11255d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:08.056931 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabf509-28ef-4ee0-98a8-26981f11255d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:08.058415 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabf509-28ef-4ee0-98a8-26981f11255d None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-fdabf509-28ef-4ee0-98a8-26981f11255d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 31 14:51:08.070204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:08.071219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:08.072160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:08.072160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:08.072160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 31 14:51:08.072160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 31 14:51:08.072160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 31 14:51:08.072160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 31 14:51:08.072160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 31 14:51:08.072160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 31 14:51:08.072160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 31 14:51:08.072160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:51:08.072160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 484/957] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:51:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:51:08.077160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a1dd6-793e-4cd9-b7dd-0dd8a044a91b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:08.173260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a1dd6-793e-4cd9-b7dd-0dd8a044a91b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:08.199296 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:08.207589 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f6153-604c-409e-b148-d8ca4c7ea2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:08.208188 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f6153-604c-409e-b148-d8ca4c7ea2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:08.208466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f6153-604c-409e-b148-d8ca4c7ea2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:08.208735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f6153-604c-409e-b148-d8ca4c7ea2c8 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:08.209490 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f6153-604c-409e-b148-d8ca4c7ea2c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:08.209790 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f6153-604c-409e-b148-d8ca4c7ea2c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:08.211200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f6153-604c-409e-b148-d8ca4c7ea2c8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:08.228296 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 474/958] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Oct 31 14:51:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:08.233946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabf509-28ef-4ee0-98a8-26981f11255d None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:08.249659 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:08.330891 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabf509-28ef-4ee0-98a8-26981f11255d None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:08.363546 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421d1d-fa61-493b-b9b9-2c3ecaa8c209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:08.364132 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421d1d-fa61-493b-b9b9-2c3ecaa8c209 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:08.364402 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421d1d-fa61-493b-b9b9-2c3ecaa8c209 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:08.364671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421d1d-fa61-493b-b9b9-2c3ecaa8c209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:08.435446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421d1d-fa61-493b-b9b9-2c3ecaa8c209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:08.436812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421d1d-fa61-493b-b9b9-2c3ecaa8c209 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:08.529863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 485/959] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Oct 31 14:51:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 31 14:51:08.536666 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f6153-604c-409e-b148-d8ca4c7ea2c8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:08.537970 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:08.632852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f6153-604c-409e-b148-d8ca4c7ea2c8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:08.668706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffacd8-bb65-4f09-a23a-c330c8dbfdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:08.669344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffacd8-bb65-4f09-a23a-c330c8dbfdc6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:08.669627 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffacd8-bb65-4f09-a23a-c330c8dbfdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:08.669896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffacd8-bb65-4f09-a23a-c330c8dbfdc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:08.679845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffacd8-bb65-4f09-a23a-c330c8dbfdc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:08.681295 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffacd8-bb65-4f09-a23a-c330c8dbfdc6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-e0ffacd8-bb65-4f09-a23a-c330c8dbfdc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 31 14:51:08.695699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:08.696693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 31 14:51:08.697623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 31 14:51:08.697623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 31 14:51:08.697623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:51:08.697623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 475/960] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 14:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:51:08.702449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421d1d-fa61-493b-b9b9-2c3ecaa8c209 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:08.799884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421d1d-fa61-493b-b9b9-2c3ecaa8c209 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:08.812559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:08.833430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bed9a-d686-47ba-aa1a-dd1e332c5689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:08.834025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bed9a-d686-47ba-aa1a-dd1e332c5689 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:08.854130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bed9a-d686-47ba-aa1a-dd1e332c5689 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:08.854130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bed9a-d686-47ba-aa1a-dd1e332c5689 None admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:08.854130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bed9a-d686-47ba-aa1a-dd1e332c5689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:08.854130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bed9a-d686-47ba-aa1a-dd1e332c5689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:08.854130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bed9a-d686-47ba-aa1a-dd1e332c5689 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:08.854130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 486/961] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Oct 31 14:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:08.854595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffacd8-bb65-4f09-a23a-c330c8dbfdc6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:08.887442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:08.950241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffacd8-bb65-4f09-a23a-c330c8dbfdc6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:08.983513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacf75f-5592-40c3-aeac-e4cde5522657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:08.984137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacf75f-5592-40c3-aeac-e4cde5522657 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:08.984413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacf75f-5592-40c3-aeac-e4cde5522657 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:08.984682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacf75f-5592-40c3-aeac-e4cde5522657 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:08.991362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacf75f-5592-40c3-aeac-e4cde5522657 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:08.992785 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacf75f-5592-40c3-aeac-e4cde5522657 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-fbacf75f-5592-40c3-aeac-e4cde5522657 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 31 14:51:09.004845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:09.009053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:09.010197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 31 14:51:09.010197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 31 14:51:09.010197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 31 14:51:09.010197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 31 14:51:09.010197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 31 14:51:09.010197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 31 14:51:09.010197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 31 14:51:09.010197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Oct 31 14:51:09.010197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 476/962] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Oct 31 14:51:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:51:09.011933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bed9a-d686-47ba-aa1a-dd1e332c5689 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:09.109295 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bed9a-d686-47ba-aa1a-dd1e332c5689 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:09.141627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cea74b-3e07-4d80-856d-658a131b6f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:09.142217 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cea74b-3e07-4d80-856d-658a131b6f80 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:09.143138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cea74b-3e07-4d80-856d-658a131b6f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:09.143568 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cea74b-3e07-4d80-856d-658a131b6f80 None admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:09.144246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cea74b-3e07-4d80-856d-658a131b6f80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:09.144544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cea74b-3e07-4d80-856d-658a131b6f80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:09.145979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cea74b-3e07-4d80-856d-658a131b6f80 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:09.157278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 487/963] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Oct 31 14:51:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:09.163963 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacf75f-5592-40c3-aeac-e4cde5522657 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:09.255499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:09.261122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacf75f-5592-40c3-aeac-e4cde5522657 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:09.294432 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bf4b6-77b7-4b7e-b3fd-4a0b29482360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:09.295021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bf4b6-77b7-4b7e-b3fd-4a0b29482360 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:09.295296 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bf4b6-77b7-4b7e-b3fd-4a0b29482360 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:09.295563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bf4b6-77b7-4b7e-b3fd-4a0b29482360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:09.296273 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bf4b6-77b7-4b7e-b3fd-4a0b29482360 None admin] RBAC: Adding query filter params (role.id=c62ffefc63e74a1280bef2b6a22202ad, scope.project.id=b82a0373e3b649f3a023efd8db204123, user.id=77b43d235d0441b3b8a272d051b54ce3) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:09.296655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bf4b6-77b7-4b7e-b3fd-4a0b29482360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:09.298078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bf4b6-77b7-4b7e-b3fd-4a0b29482360 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:09.304377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 477/964] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Oct 31 14:51:09 2022] GET /identity/v3/role_assignments?user.id=77b43d235d0441b3b8a272d051b54ce3&scope.project.id=b82a0373e3b649f3a023efd8db204123&role.id=c62ffefc63e74a1280bef2b6a22202ad => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:11.463491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e20d4-fdf7-4277-a42d-c7bdebf45e7c None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:11.464085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e20d4-fdf7-4277-a42d-c7bdebf45e7c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:11.464085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e20d4-fdf7-4277-a42d-c7bdebf45e7c None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:11.465374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 488/965] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:51:11.471112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a448-aacb-446b-8197-3f855966fdc9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:11.471556 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a448-aacb-446b-8197-3f855966fdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:11.471646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a448-aacb-446b-8197-3f855966fdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:11.491512 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-02e7a448-aacb-446b-8197-3f855966fdc9 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:11.494826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-02e7a448-aacb-446b-8197-3f855966fdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:11.557743 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 478/966] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:51:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:51:11.830537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e20d4-fdf7-4277-a42d-c7bdebf45e7c None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:11.861638 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:11.937898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e20d4-fdf7-4277-a42d-c7bdebf45e7c None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:11.972668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d45d-ab2b-44af-b205-cb8ed67668c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:11.973340 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d45d-ab2b-44af-b205-cb8ed67668c2 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:11.973617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d45d-ab2b-44af-b205-cb8ed67668c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:11.973882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d45d-ab2b-44af-b205-cb8ed67668c2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:11.974523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0d45d-ab2b-44af-b205-cb8ed67668c2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:11.975915 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0d45d-ab2b-44af-b205-cb8ed67668c2 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-ffd0d45d-ab2b-44af-b205-cb8ed67668c2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:11.984862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:11.986892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:51:11.988095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 489/967] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 31 14:51:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:51:11.992275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7a448-aacb-446b-8197-3f855966fdc9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:12.079492 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:12.089115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7a448-aacb-446b-8197-3f855966fdc9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:12.121112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074a9c7-69e7-4564-b088-ea36057074a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:12.121735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074a9c7-69e7-4564-b088-ea36057074a9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:12.122010 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074a9c7-69e7-4564-b088-ea36057074a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:12.122275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074a9c7-69e7-4564-b088-ea36057074a9 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:12.122893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074a9c7-69e7-4564-b088-ea36057074a9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:12.123189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074a9c7-69e7-4564-b088-ea36057074a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:12.124578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074a9c7-69e7-4564-b088-ea36057074a9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:12.130227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 479/968] 10.222.0.45 () {56 vars in 1116 bytes} [Mon Oct 31 14:51:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:12.136002 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d45d-ab2b-44af-b205-cb8ed67668c2 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:12.229922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:12.235653 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d45d-ab2b-44af-b205-cb8ed67668c2 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:12.268926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871945bc-5cce-472f-81f1-8332f70d933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:12.269549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871945bc-5cce-472f-81f1-8332f70d933f None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:12.269826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871945bc-5cce-472f-81f1-8332f70d933f None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:12.270090 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871945bc-5cce-472f-81f1-8332f70d933f None admin] PATH_INFO: `/v3/services` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:12.270725 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871945bc-5cce-472f-81f1-8332f70d933f None admin] RBAC: Adding query filter params (type=placement) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:12.271005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871945bc-5cce-472f-81f1-8332f70d933f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:12.272356 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871945bc-5cce-472f-81f1-8332f70d933f None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:12.276790 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 490/969] 10.222.0.45 () {56 vars in 1116 bytes} [Mon Oct 31 14:51:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:14.407947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1a3a1-28d8-426f-a0ad-7f4c33d85d86 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:14.408885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1a3a1-28d8-426f-a0ad-7f4c33d85d86 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:14.408885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1a3a1-28d8-426f-a0ad-7f4c33d85d86 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:14.410149 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 480/970] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:51:14.415594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69a2b3-6c01-4043-a227-fd4ce11bf441 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:14.422124 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69a2b3-6c01-4043-a227-fd4ce11bf441 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:14.422124 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69a2b3-6c01-4043-a227-fd4ce11bf441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:14.434951 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-cb69a2b3-6c01-4043-a227-fd4ce11bf441 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:14.436134 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-cb69a2b3-6c01-4043-a227-fd4ce11bf441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:14.502769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 491/971] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:51:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:51:14.775235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1a3a1-28d8-426f-a0ad-7f4c33d85d86 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:14.873669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1a3a1-28d8-426f-a0ad-7f4c33d85d86 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:14.907376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452c4ec-95b8-42a3-b937-a00bd75ef875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:14.908548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452c4ec-95b8-42a3-b937-a00bd75ef875 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:14.909071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452c4ec-95b8-42a3-b937-a00bd75ef875 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:14.909362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452c4ec-95b8-42a3-b937-a00bd75ef875 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:14.910018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452c4ec-95b8-42a3-b937-a00bd75ef875 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:14.911365 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452c4ec-95b8-42a3-b937-a00bd75ef875 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:15.070017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 481/972] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Oct 31 14:51:14 2022] POST /identity/v3/services => generated 246 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 14:51:17.227688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889565d-e895-41b3-8cc1-982c98d861ce None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:17.228314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889565d-e895-41b3-8cc1-982c98d861ce None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:17.228314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889565d-e895-41b3-8cc1-982c98d861ce None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:17.229580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 492/973] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:51:17.234771 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d4d60-b21b-4d9a-a4c4-96ba42ad5160 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:17.235207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d4d60-b21b-4d9a-a4c4-96ba42ad5160 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:17.235315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d4d60-b21b-4d9a-a4c4-96ba42ad5160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:17.253436 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1d8d4d60-b21b-4d9a-a4c4-96ba42ad5160 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:17.254606 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1d8d4d60-b21b-4d9a-a4c4-96ba42ad5160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:17.263469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:17.324848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 482/974] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:51:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:51:17.593011 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889565d-e895-41b3-8cc1-982c98d861ce None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:17.681571 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:17.692023 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889565d-e895-41b3-8cc1-982c98d861ce None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:17.725671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3776c24-7c70-49b5-8756-2a61dd543726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:17.731617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3776c24-7c70-49b5-8756-2a61dd543726 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:17.731617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3776c24-7c70-49b5-8756-2a61dd543726 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:17.731617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3776c24-7c70-49b5-8756-2a61dd543726 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:17.731617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3776c24-7c70-49b5-8756-2a61dd543726 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:17.731617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3776c24-7c70-49b5-8756-2a61dd543726 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-c3776c24-7c70-49b5-8756-2a61dd543726 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:17.737176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:17.738142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:51:17.738956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 493/975] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 31 14:51:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:51:17.744345 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d4d60-b21b-4d9a-a4c4-96ba42ad5160 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:17.839708 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d4d60-b21b-4d9a-a4c4-96ba42ad5160 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:17.872594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf065c-8107-4432-8e13-6d5ff6432c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:17.873122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf065c-8107-4432-8e13-6d5ff6432c8c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:17.873424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf065c-8107-4432-8e13-6d5ff6432c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:17.873690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf065c-8107-4432-8e13-6d5ff6432c8c None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:17.874303 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf065c-8107-4432-8e13-6d5ff6432c8c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:17.874595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf065c-8107-4432-8e13-6d5ff6432c8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:17.875935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf065c-8107-4432-8e13-6d5ff6432c8c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:17.881006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 483/976] 10.222.0.45 () {56 vars in 1116 bytes} [Mon Oct 31 14:51:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:17.887093 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3776c24-7c70-49b5-8756-2a61dd543726 None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:17.986711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3776c24-7c70-49b5-8756-2a61dd543726 None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:18.021175 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37078aaf-3442-4e53-be3f-1cf9750d36a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:18.021817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37078aaf-3442-4e53-be3f-1cf9750d36a6 None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:18.022096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37078aaf-3442-4e53-be3f-1cf9750d36a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:18.022388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37078aaf-3442-4e53-be3f-1cf9750d36a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:18.023085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37078aaf-3442-4e53-be3f-1cf9750d36a6 None admin] RBAC: Adding query filter params (interface=public, service_id=c3316e759ea148bba8471c36e4e63bc2, region_id=RegionOne) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:18.023408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37078aaf-3442-4e53-be3f-1cf9750d36a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:18.024766 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37078aaf-3442-4e53-be3f-1cf9750d36a6 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:18.029998 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 494/977] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Oct 31 14:51:17 2022] GET /identity/v3/endpoints?service_id=c3316e759ea148bba8471c36e4e63bc2&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:18.036326 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf065c-8107-4432-8e13-6d5ff6432c8c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:18.040804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:18.134405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf065c-8107-4432-8e13-6d5ff6432c8c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:18.167796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753001b1-f89a-4b37-8cac-3366549278c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:18.168385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753001b1-f89a-4b37-8cac-3366549278c0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:18.168659 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753001b1-f89a-4b37-8cac-3366549278c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:18.168926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753001b1-f89a-4b37-8cac-3366549278c0 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:18.169548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753001b1-f89a-4b37-8cac-3366549278c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:18.170922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753001b1-f89a-4b37-8cac-3366549278c0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:18.178536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 484/978] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Oct 31 14:51:18 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 14:51:20.316615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e1a2-6c2c-44a2-9fcd-454a54f381e5 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:20.317135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e1a2-6c2c-44a2-9fcd-454a54f381e5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:20.317135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e1a2-6c2c-44a2-9fcd-454a54f381e5 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:20.318561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 495/979] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 14:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 14:51:20.323692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bb601-05f6-490d-9740-db7a662b1e27 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:20.324110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bb601-05f6-490d-9740-db7a662b1e27 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:20.324227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bb601-05f6-490d-9740-db7a662b1e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:20.341966 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2c6bb601-05f6-490d-9740-db7a662b1e27 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 14:51:20.343126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2c6bb601-05f6-490d-9740-db7a662b1e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 14:51:20.403903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:20.410397 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 485/980] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 14:51:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 31 14:51:20.679356 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51e1a2-6c2c-44a2-9fcd-454a54f381e5 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:20.699626 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:20.781362 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51e1a2-6c2c-44a2-9fcd-454a54f381e5 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:20.815064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e7aef-0bc6-4e09-a46b-e381e8bec80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:20.815672 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e7aef-0bc6-4e09-a46b-e381e8bec80b None admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:20.815945 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e7aef-0bc6-4e09-a46b-e381e8bec80b None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:20.816210 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e7aef-0bc6-4e09-a46b-e381e8bec80b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:20.816779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e7aef-0bc6-4e09-a46b-e381e8bec80b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:20.818155 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e7aef-0bc6-4e09-a46b-e381e8bec80b None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application [None req-657e7aef-0bc6-4e09-a46b-e381e8bec80b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 31 14:51:20.826688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 31 14:51:20.827927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.get_or_create( Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application with Lock( Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self._enter() Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application return self.creator() Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application created_value = creator( Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: ERROR keystone.server.flask.application Oct 31 14:51:20.828755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 496/981] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Oct 31 14:51:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 31 14:51:20.834007 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bb601-05f6-490d-9740-db7a662b1e27 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:20.930065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bb601-05f6-490d-9740-db7a662b1e27 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:20.962884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859944b0-08f5-4364-8289-ebaa9a75336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:20.963482 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859944b0-08f5-4364-8289-ebaa9a75336e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:20.963752 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859944b0-08f5-4364-8289-ebaa9a75336e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:20.964019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859944b0-08f5-4364-8289-ebaa9a75336e None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:20.964636 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859944b0-08f5-4364-8289-ebaa9a75336e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 14:51:20.964976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859944b0-08f5-4364-8289-ebaa9a75336e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:20.966342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859944b0-08f5-4364-8289-ebaa9a75336e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:20.972483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 486/982] 10.222.0.45 () {56 vars in 1116 bytes} [Mon Oct 31 14:51:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 14:51:20.978605 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e7aef-0bc6-4e09-a46b-e381e8bec80b None admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 14:51:21.060272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:21.078126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e7aef-0bc6-4e09-a46b-e381e8bec80b None admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 14:51:21.111776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028b38b-a988-4f5f-8cef-d405df78dbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 14:51:21.112365 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028b38b-a988-4f5f-8cef-d405df78dbe4 None admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 14:51:21.112643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028b38b-a988-4f5f-8cef-d405df78dbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 14:51:21.112908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028b38b-a988-4f5f-8cef-d405df78dbe4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 14:51:21.113598 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028b38b-a988-4f5f-8cef-d405df78dbe4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 14:51:21.114954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028b38b-a988-4f5f-8cef-d405df78dbe4 None admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 14:51:21.225705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 497/983] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 14:51:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 14:51:30.968326 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=69 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 14:51:31.219878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:32.216720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd887f-e4a5-43f8-abe3-8062fc8058ce None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:32.217190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd887f-e4a5-43f8-abe3-8062fc8058ce None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:32.217458 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd887f-e4a5-43f8-abe3-8062fc8058ce None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:32.223790 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea9c02-378a-4887-a89c-feb2037679f5 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:32.224170 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea9c02-378a-4887-a89c-feb2037679f5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:32.224332 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea9c02-378a-4887-a89c-feb2037679f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:32.229821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 487/984] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:00:32 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:00:32.360326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-62ea9c02-378a-4887-a89c-feb2037679f5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:32.362044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-62ea9c02-378a-4887-a89c-feb2037679f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:32.469614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 498/985] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:00:32.769180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2068b-3c8b-49c2-9829-1a235a6b8c53 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:32.769501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2068b-3c8b-49c2-9829-1a235a6b8c53 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:32.770032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2068b-3c8b-49c2-9829-1a235a6b8c53 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:32.771444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 488/986] 10.222.0.45 () {54 vars in 965 bytes} [Mon Oct 31 15:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:00:32.778239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d69923-9b36-4f1a-97a0-c107378421dc None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:32.778529 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d69923-9b36-4f1a-97a0-c107378421dc None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:32.778944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d69923-9b36-4f1a-97a0-c107378421dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:32.866877 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-15d69923-9b36-4f1a-97a0-c107378421dc None None] MFA Rules not processed for user `93815827ae97419abf6fa45fbab185f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:32.868157 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-15d69923-9b36-4f1a-97a0-c107378421dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:32.890854 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:32.951537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 499/987] 10.222.0.45 () {58 vars in 1062 bytes} [Mon Oct 31 15:00:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:32.960651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2068b-3c8b-49c2-9829-1a235a6b8c53 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:32.962458 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3ab2068b-3c8b-49c2-9829-1a235a6b8c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:33.081176 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2068b-3c8b-49c2-9829-1a235a6b8c53 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:33.168711 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f3e78-7e54-4a27-973a-bbcb168f00f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:33.169506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f3e78-7e54-4a27-973a-bbcb168f00f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:33.169879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f3e78-7e54-4a27-973a-bbcb168f00f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:33.170264 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f3e78-7e54-4a27-973a-bbcb168f00f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:33.171986 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1d1f3e78-7e54-4a27-973a-bbcb168f00f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:33.232484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:33.292643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f3e78-7e54-4a27-973a-bbcb168f00f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:33.294302 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f3e78-7e54-4a27-973a-bbcb168f00f8 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:33.316366 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 489/988] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:35.864808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8196b-4ee1-45b7-b8d9-7b21c33f4cfc None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:35.865335 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8196b-4ee1-45b7-b8d9-7b21c33f4cfc None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:35.865450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8196b-4ee1-45b7-b8d9-7b21c33f4cfc None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:35.866781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 500/989] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:00:35.872029 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a35c9-346f-429f-b0f2-6620447268ff None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:35.872420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a35c9-346f-429f-b0f2-6620447268ff None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:35.872582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a35c9-346f-429f-b0f2-6620447268ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:35.953800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6b1a35c9-346f-429f-b0f2-6620447268ff None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:35.955007 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6b1a35c9-346f-429f-b0f2-6620447268ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:36.055302 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 490/990] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:36.340287 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8196b-4ee1-45b7-b8d9-7b21c33f4cfc None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:36.341876 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-33c8196b-4ee1-45b7-b8d9-7b21c33f4cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:36.444328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8196b-4ee1-45b7-b8d9-7b21c33f4cfc None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:36.515912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:36.518199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d0425-e2e3-4c48-8e33-f012185057ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:36.518794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d0425-e2e3-4c48-8e33-f012185057ce service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:36.519066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d0425-e2e3-4c48-8e33-f012185057ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:36.519332 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d0425-e2e3-4c48-8e33-f012185057ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:36.520905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7a1d0425-e2e3-4c48-8e33-f012185057ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:36.629184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d0425-e2e3-4c48-8e33-f012185057ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:36.630549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d0425-e2e3-4c48-8e33-f012185057ce service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:36.647998 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 501/991] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:39.385344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565180f7-1459-40c6-9384-3a748df33e65 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:39.386306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565180f7-1459-40c6-9384-3a748df33e65 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:39.386306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565180f7-1459-40c6-9384-3a748df33e65 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:39.387221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 491/992] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:00:39.392663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a2db-2bfd-40d4-bce1-a37ad8953dc4 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:39.393090 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a2db-2bfd-40d4-bce1-a37ad8953dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:39.393182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a2db-2bfd-40d4-bce1-a37ad8953dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:39.459104 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-a9a6a2db-2bfd-40d4-bce1-a37ad8953dc4 None None] MFA Rules not processed for user `796510ac3b2b4676b340c1699bc540e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:39.460340 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a9a6a2db-2bfd-40d4-bce1-a37ad8953dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:39.512846 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:39.557487 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 502/993] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:00:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:39.843515 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565180f7-1459-40c6-9384-3a748df33e65 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:39.845047 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-565180f7-1459-40c6-9384-3a748df33e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:39.854902 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:39.946196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565180f7-1459-40c6-9384-3a748df33e65 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:40.020120 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eeb849-cbe6-4a9c-9b0d-44df668199a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:40.020647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeb849-cbe6-4a9c-9b0d-44df668199a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:40.020920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeb849-cbe6-4a9c-9b0d-44df668199a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:40.021186 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eeb849-cbe6-4a9c-9b0d-44df668199a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:40.022784 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-49eeb849-cbe6-4a9c-9b0d-44df668199a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:40.085541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:40.130324 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eeb849-cbe6-4a9c-9b0d-44df668199a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:40.131742 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eeb849-cbe6-4a9c-9b0d-44df668199a9 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:40.149583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 492/994] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:43.370944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f6f11-09ed-4820-855e-b8f783661765 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:43.371504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f6f11-09ed-4820-855e-b8f783661765 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:43.371504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f6f11-09ed-4820-855e-b8f783661765 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:43.372829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 503/995] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:00:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:00:43.378271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f0264-c687-4e35-8704-432a7a128a42 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:43.378647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f0264-c687-4e35-8704-432a7a128a42 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:43.378819 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f0264-c687-4e35-8704-432a7a128a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:43.445158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-298f0264-c687-4e35-8704-432a7a128a42 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:43.446396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-298f0264-c687-4e35-8704-432a7a128a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:43.543574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 493/996] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:00:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:43.833708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f6f11-09ed-4820-855e-b8f783661765 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:43.835236 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a41f6f11-09ed-4820-855e-b8f783661765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:43.938771 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f6f11-09ed-4820-855e-b8f783661765 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:44.012911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fb7ee-c227-4b53-98a8-2eb3ff74ba48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:44.013469 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb7ee-c227-4b53-98a8-2eb3ff74ba48 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:44.013777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb7ee-c227-4b53-98a8-2eb3ff74ba48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:44.014016 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fb7ee-c227-4b53-98a8-2eb3ff74ba48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:44.015597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b48fb7ee-c227-4b53-98a8-2eb3ff74ba48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:44.022456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:44.125711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fb7ee-c227-4b53-98a8-2eb3ff74ba48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:44.127160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fb7ee-c227-4b53-98a8-2eb3ff74ba48 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:44.145517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 504/997] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:47.426072 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769cfb0-e455-4b0c-bae0-0ba9d9299e68 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:47.426649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769cfb0-e455-4b0c-bae0-0ba9d9299e68 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:47.426649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769cfb0-e455-4b0c-bae0-0ba9d9299e68 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:47.427972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 494/998] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:00:47.433396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674edb8e-5697-474d-8819-594369a15f89 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:47.442062 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674edb8e-5697-474d-8819-594369a15f89 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:47.442062 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674edb8e-5697-474d-8819-594369a15f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:47.501299 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-674edb8e-5697-474d-8819-594369a15f89 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:47.502513 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-674edb8e-5697-474d-8819-594369a15f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:47.561446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:47.599089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 505/999] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:47.884755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769cfb0-e455-4b0c-bae0-0ba9d9299e68 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:47.886473 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3769cfb0-e455-4b0c-bae0-0ba9d9299e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:47.906723 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:48.001683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769cfb0-e455-4b0c-bae0-0ba9d9299e68 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:48.082401 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cac20-1fdd-4b7a-8e52-352aa2b9f33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:48.082998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cac20-1fdd-4b7a-8e52-352aa2b9f33d service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:48.083271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cac20-1fdd-4b7a-8e52-352aa2b9f33d service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:48.083537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cac20-1fdd-4b7a-8e52-352aa2b9f33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:48.085116 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a68cac20-1fdd-4b7a-8e52-352aa2b9f33d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:48.156665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:48.196217 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cac20-1fdd-4b7a-8e52-352aa2b9f33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:48.198357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cac20-1fdd-4b7a-8e52-352aa2b9f33d service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:48.216755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 495/1000] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:50.430604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce489d69-d94a-43e5-97b9-2c9c7b36e95a None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:50.431130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce489d69-d94a-43e5-97b9-2c9c7b36e95a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:50.431130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce489d69-d94a-43e5-97b9-2c9c7b36e95a None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:50.432560 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 506/1001] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:00:50.437760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9be9a-b1b7-43ff-a7e0-28befc063057 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:50.438194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9be9a-b1b7-43ff-a7e0-28befc063057 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:50.438284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9be9a-b1b7-43ff-a7e0-28befc063057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:50.505591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-22b9be9a-b1b7-43ff-a7e0-28befc063057 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:50.506789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-22b9be9a-b1b7-43ff-a7e0-28befc063057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:50.603940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 496/1002] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:50.891100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce489d69-d94a-43e5-97b9-2c9c7b36e95a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:50.892712 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ce489d69-d94a-43e5-97b9-2c9c7b36e95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:51.009554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce489d69-d94a-43e5-97b9-2c9c7b36e95a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:51.085422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a834ed7-0078-4746-95d3-4bee02bbaab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:51.086021 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a834ed7-0078-4746-95d3-4bee02bbaab4 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:51.086295 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a834ed7-0078-4746-95d3-4bee02bbaab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:51.086561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a834ed7-0078-4746-95d3-4bee02bbaab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:51.088758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7a834ed7-0078-4746-95d3-4bee02bbaab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:51.105779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:51.202434 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a834ed7-0078-4746-95d3-4bee02bbaab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:51.203936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a834ed7-0078-4746-95d3-4bee02bbaab4 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:51.222547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 507/1003] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:53.453260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894d088-34f3-4038-82b2-3a17678d318a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:53.453802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894d088-34f3-4038-82b2-3a17678d318a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:53.453914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894d088-34f3-4038-82b2-3a17678d318a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:53.455160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 497/1004] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:00:53.460689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8638f-c9a8-46f4-9e02-4aafbf565eca None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:53.461106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8638f-c9a8-46f4-9e02-4aafbf565eca None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:53.461413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8638f-c9a8-46f4-9e02-4aafbf565eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:53.527757 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-acb8638f-c9a8-46f4-9e02-4aafbf565eca None None] MFA Rules not processed for user `796510ac3b2b4676b340c1699bc540e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:53.528963 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-acb8638f-c9a8-46f4-9e02-4aafbf565eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:53.591737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:53.634216 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 508/1005] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:00:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:53.918753 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894d088-34f3-4038-82b2-3a17678d318a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:53.920564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0894d088-34f3-4038-82b2-3a17678d318a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:53.961979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:54.043794 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894d088-34f3-4038-82b2-3a17678d318a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:54.118965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596cebf-07f5-47dc-a5a3-429ae6dc7e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:54.120194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596cebf-07f5-47dc-a5a3-429ae6dc7e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:54.120461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596cebf-07f5-47dc-a5a3-429ae6dc7e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:54.120754 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596cebf-07f5-47dc-a5a3-429ae6dc7e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:54.122360 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9596cebf-07f5-47dc-a5a3-429ae6dc7e12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:54.200003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:54.234310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596cebf-07f5-47dc-a5a3-429ae6dc7e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:54.235650 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596cebf-07f5-47dc-a5a3-429ae6dc7e12 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:54.257494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 498/1006] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:56.961554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd162d8-d607-408e-b5ee-736bfc459a0b None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:56.962137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd162d8-d607-408e-b5ee-736bfc459a0b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:56.962137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd162d8-d607-408e-b5ee-736bfc459a0b None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:56.963576 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 509/1007] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:00:56.968762 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e67a11-aa46-4dc2-98e8-22959fef257c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:56.969211 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e67a11-aa46-4dc2-98e8-22959fef257c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:56.969335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e67a11-aa46-4dc2-98e8-22959fef257c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:57.034908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-22e67a11-aa46-4dc2-98e8-22959fef257c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:00:57.036101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-22e67a11-aa46-4dc2-98e8-22959fef257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:57.133703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 499/1008] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:00:57.414838 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd162d8-d607-408e-b5ee-736bfc459a0b None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:00:57.417083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-cdd162d8-d607-408e-b5ee-736bfc459a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:57.518795 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd162d8-d607-408e-b5ee-736bfc459a0b None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:00:57.592928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828b8b0-15e5-47a0-abfa-300c11a51c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:00:57.593553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828b8b0-15e5-47a0-abfa-300c11a51c7b service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:57.593828 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828b8b0-15e5-47a0-abfa-300c11a51c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:57.594092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828b8b0-15e5-47a0-abfa-300c11a51c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:57.595702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2828b8b0-15e5-47a0-abfa-300c11a51c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:00:57.622263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:00:57.702750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828b8b0-15e5-47a0-abfa-300c11a51c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:00:57.704089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828b8b0-15e5-47a0-abfa-300c11a51c7b service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:00:57.723168 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 510/1009] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:00:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:00:59.932742 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2dacf-8347-4ce5-b508-2f686f594d38 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:59.933331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2dacf-8347-4ce5-b508-2f686f594d38 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:59.933331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2dacf-8347-4ce5-b508-2f686f594d38 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:00:59.934649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 500/1010] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:00:59.940059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b92694-10f5-40ea-ba9f-a80fe836d38c None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:00:59.940528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b92694-10f5-40ea-ba9f-a80fe836d38c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:00:59.940625 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b92694-10f5-40ea-ba9f-a80fe836d38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:00.007143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-a0b92694-10f5-40ea-ba9f-a80fe836d38c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:00.008346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a0b92694-10f5-40ea-ba9f-a80fe836d38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:00.083688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:00.105926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 511/1011] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:00.407052 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e9b25-59a7-4336-84b1-9b4c152d65ff None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:00.407336 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e9b25-59a7-4336-84b1-9b4c152d65ff None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:00.407601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e9b25-59a7-4336-84b1-9b4c152d65ff None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:00.408959 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 501/1012] 10.222.0.45 () {54 vars in 965 bytes} [Mon Oct 31 15:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:00.414873 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993878d-999e-42c9-9e96-78c3e407b5f3 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:00.415152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993878d-999e-42c9-9e96-78c3e407b5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:00.415423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993878d-999e-42c9-9e96-78c3e407b5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:00.490146 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-b993878d-999e-42c9-9e96-78c3e407b5f3 None None] MFA Rules not processed for user `93815827ae97419abf6fa45fbab185f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:00.491349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b993878d-999e-42c9-9e96-78c3e407b5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:00.568171 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 512/1013] 10.222.0.45 () {58 vars in 1062 bytes} [Mon Oct 31 15:01:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:00.578044 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e9b25-59a7-4336-84b1-9b4c152d65ff None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:00.579594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-625e9b25-59a7-4336-84b1-9b4c152d65ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:00.620365 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:00.684833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e9b25-59a7-4336-84b1-9b4c152d65ff None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:00.755693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c723fa-daa8-482c-935f-f82b392060d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:00.756291 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c723fa-daa8-482c-935f-f82b392060d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:00.756560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c723fa-daa8-482c-935f-f82b392060d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:00.756823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c723fa-daa8-482c-935f-f82b392060d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:00.758430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-34c723fa-daa8-482c-935f-f82b392060d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:00.841469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:00.867066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c723fa-daa8-482c-935f-f82b392060d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:00.868478 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c723fa-daa8-482c-935f-f82b392060d4 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:00.887300 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 502/1014] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:04.309798 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2ac22-d71c-4d9e-916d-c8aef76343da None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:04.310355 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2ac22-d71c-4d9e-916d-c8aef76343da None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:04.310355 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2ac22-d71c-4d9e-916d-c8aef76343da None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:04.311691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 513/1015] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:04.316926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b83336-c58c-4fbd-802a-f75ffd4faf39 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:04.317328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b83336-c58c-4fbd-802a-f75ffd4faf39 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:04.317494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b83336-c58c-4fbd-802a-f75ffd4faf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:04.384196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-86b83336-c58c-4fbd-802a-f75ffd4faf39 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:04.386147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-86b83336-c58c-4fbd-802a-f75ffd4faf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:04.482788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 503/1016] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:01:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:04.766184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2ac22-d71c-4d9e-916d-c8aef76343da None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:04.767754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a2b2ac22-d71c-4d9e-916d-c8aef76343da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:04.845390 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:04.872775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2ac22-d71c-4d9e-916d-c8aef76343da None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:04.946640 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31649119-b5be-4a8f-971b-76619365a6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:04.947271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31649119-b5be-4a8f-971b-76619365a6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:04.947578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31649119-b5be-4a8f-971b-76619365a6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:04.947842 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31649119-b5be-4a8f-971b-76619365a6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:04.949488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-31649119-b5be-4a8f-971b-76619365a6f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:05.057388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31649119-b5be-4a8f-971b-76619365a6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:05.058818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31649119-b5be-4a8f-971b-76619365a6f4 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:05.077352 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 514/1017] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:09.652053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5dac4-5f78-4ae8-b361-a8919e12ff4e None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:09.652567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5dac4-5f78-4ae8-b361-a8919e12ff4e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:09.652567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5dac4-5f78-4ae8-b361-a8919e12ff4e None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:09.653928 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 504/1018] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:09.659218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d185ad-9fd7-4186-9e56-5b06840bc4f2 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:09.659640 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d185ad-9fd7-4186-9e56-5b06840bc4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:09.659745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d185ad-9fd7-4186-9e56-5b06840bc4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:09.666090 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:09.729754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-c4d185ad-9fd7-4186-9e56-5b06840bc4f2 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:09.730964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c4d185ad-9fd7-4186-9e56-5b06840bc4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:09.830182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 515/1019] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:10.114083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5dac4-5f78-4ae8-b361-a8919e12ff4e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:10.115718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e7e5dac4-5f78-4ae8-b361-a8919e12ff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:10.165850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:10.227595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5dac4-5f78-4ae8-b361-a8919e12ff4e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:10.307448 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7ac46-5ad9-4099-b1ba-401c7327b06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:10.307977 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7ac46-5ad9-4099-b1ba-401c7327b06b service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:10.308257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7ac46-5ad9-4099-b1ba-401c7327b06b service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:10.308528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7ac46-5ad9-4099-b1ba-401c7327b06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:10.310244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-73e7ac46-5ad9-4099-b1ba-401c7327b06b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:10.403944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:10.420675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7ac46-5ad9-4099-b1ba-401c7327b06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:10.432215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7ac46-5ad9-4099-b1ba-401c7327b06b service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:10.441006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 505/1020] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:14.137403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aedcc8-61e9-45cb-9d23-e5f1085eb1a9 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:14.137929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aedcc8-61e9-45cb-9d23-e5f1085eb1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:14.137929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aedcc8-61e9-45cb-9d23-e5f1085eb1a9 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:14.139266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 516/1021] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:14.144391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c62254-1842-4bf2-97bf-b387e4251988 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:14.144780 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c62254-1842-4bf2-97bf-b387e4251988 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:14.145009 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c62254-1842-4bf2-97bf-b387e4251988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:14.215712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-71c62254-1842-4bf2-97bf-b387e4251988 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:14.216843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-71c62254-1842-4bf2-97bf-b387e4251988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:14.318067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 506/1022] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:01:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:14.623036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aedcc8-61e9-45cb-9d23-e5f1085eb1a9 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:14.624584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-88aedcc8-61e9-45cb-9d23-e5f1085eb1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:14.720815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:14.755845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aedcc8-61e9-45cb-9d23-e5f1085eb1a9 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:14.819143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97f32f-a3b8-480a-b249-b9164886782d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:14.819740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97f32f-a3b8-480a-b249-b9164886782d service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:14.820010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97f32f-a3b8-480a-b249-b9164886782d service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:14.820280 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97f32f-a3b8-480a-b249-b9164886782d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:14.822189 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ec97f32f-a3b8-480a-b249-b9164886782d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:14.933789 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97f32f-a3b8-480a-b249-b9164886782d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:14.935225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97f32f-a3b8-480a-b249-b9164886782d service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:14.953552 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 517/1023] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:19.370041 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7944e-e872-4211-93eb-e9f0b397b8f0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:19.370757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7944e-e872-4211-93eb-e9f0b397b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:19.370757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7944e-e872-4211-93eb-e9f0b397b8f0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:19.371972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 507/1024] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:19.377588 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fc6f2-cb49-4db6-9453-42562b2a92db None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:19.378032 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fc6f2-cb49-4db6-9453-42562b2a92db None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:19.378126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fc6f2-cb49-4db6-9453-42562b2a92db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:19.395041 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:19.453484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d78fc6f2-cb49-4db6-9453-42562b2a92db None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:19.454749 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d78fc6f2-cb49-4db6-9453-42562b2a92db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:19.559608 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 518/1025] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:19.849583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7944e-e872-4211-93eb-e9f0b397b8f0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:19.851118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-71b7944e-e872-4211-93eb-e9f0b397b8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:19.916819 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:19.963039 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7944e-e872-4211-93eb-e9f0b397b8f0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:20.041226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef9d50-e8b0-4387-b459-cae547c1a68b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:20.041861 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef9d50-e8b0-4387-b459-cae547c1a68b service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:20.042139 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef9d50-e8b0-4387-b459-cae547c1a68b service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:20.042407 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef9d50-e8b0-4387-b459-cae547c1a68b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:20.044063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-68ef9d50-e8b0-4387-b459-cae547c1a68b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:20.153577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:20.157049 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef9d50-e8b0-4387-b459-cae547c1a68b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:20.158505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef9d50-e8b0-4387-b459-cae547c1a68b service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:20.176718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 508/1026] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:25.219128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067238d2-99a1-473a-9a72-cb6e3b091d76 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:25.219128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067238d2-99a1-473a-9a72-cb6e3b091d76 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:25.219128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067238d2-99a1-473a-9a72-cb6e3b091d76 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:25.219776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 519/1027] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 31 15:01:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:25.225931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e567e81-3d9f-4755-8853-6b871c3da0ab None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:25.225931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e567e81-3d9f-4755-8853-6b871c3da0ab None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:25.225931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e567e81-3d9f-4755-8853-6b871c3da0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:25.352271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6e567e81-3d9f-4755-8853-6b871c3da0ab None None] MFA Rules not processed for user `77b43d235d0441b3b8a272d051b54ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:25.353752 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6e567e81-3d9f-4755-8853-6b871c3da0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:25.471428 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 509/1028] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 31 15:01:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:29.454309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b71338-4186-46f4-aded-3b5e738ea8cb None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:29.454865 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b71338-4186-46f4-aded-3b5e738ea8cb None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:29.454865 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b71338-4186-46f4-aded-3b5e738ea8cb None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:29.456504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 520/1029] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 31 15:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:29.461797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f5d38-b3e3-442e-9249-81c214e47dd5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:29.462261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f5d38-b3e3-442e-9249-81c214e47dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:29.462521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f5d38-b3e3-442e-9249-81c214e47dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:29.519413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:29.544658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cc3f5d38-b3e3-442e-9249-81c214e47dd5 None None] MFA Rules not processed for user `77b43d235d0441b3b8a272d051b54ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:29.545890 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cc3f5d38-b3e3-442e-9249-81c214e47dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:29.557981 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=59 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:29.658394 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 510/1030] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 31 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:31.248259 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39284e2-6bb3-4f9e-ab11-1c80c125b60d None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:31.248769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39284e2-6bb3-4f9e-ab11-1c80c125b60d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:31.248769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39284e2-6bb3-4f9e-ab11-1c80c125b60d None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:31.250059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 521/1031] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 31 15:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:31.255152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22510150-07cb-464e-81cd-edb0025dcbb0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:31.255993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22510150-07cb-464e-81cd-edb0025dcbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:31.256268 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22510150-07cb-464e-81cd-edb0025dcbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:31.334969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-22510150-07cb-464e-81cd-edb0025dcbb0 None None] MFA Rules not processed for user `77b43d235d0441b3b8a272d051b54ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:31.336215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-22510150-07cb-464e-81cd-edb0025dcbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:31.378137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:31.442180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 511/1032] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 31 15:01:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:01:35.138073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327f84-8af7-4e6c-adf4-913ff32c29de None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:35.138890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327f84-8af7-4e6c-adf4-913ff32c29de None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:35.139315 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327f84-8af7-4e6c-adf4-913ff32c29de None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:35.141220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 522/1033] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:35.147334 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d367eb-229b-48f9-bdd5-a87d458bdf9a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:35.147890 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d367eb-229b-48f9-bdd5-a87d458bdf9a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:35.147890 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d367eb-229b-48f9-bdd5-a87d458bdf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:35.222899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-07d367eb-229b-48f9-bdd5-a87d458bdf9a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:35.224109 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-07d367eb-229b-48f9-bdd5-a87d458bdf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:35.333413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 512/1034] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:01:35.634282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af322bd-1a5e-4947-a43d-f132fe3eedc6 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:35.635179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af322bd-1a5e-4947-a43d-f132fe3eedc6 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:35.635946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af322bd-1a5e-4947-a43d-f132fe3eedc6 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:35.639139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 523/1035] 10.222.0.45 () {54 vars in 961 bytes} [Mon Oct 31 15:01:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:35.647351 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa73d1-3392-47bd-892c-d313bf68945c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:35.647639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa73d1-3392-47bd-892c-d313bf68945c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:35.647917 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa73d1-3392-47bd-892c-d313bf68945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:35.669041 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:35.741931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-03aa73d1-3392-47bd-892c-d313bf68945c None None] MFA Rules not processed for user `9ec30e419d6f4fddb05c4bb08f2ce3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:35.743630 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-03aa73d1-3392-47bd-892c-d313bf68945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:35.865188 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 513/1036] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Oct 31 15:01:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:35.873327 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af322bd-1a5e-4947-a43d-f132fe3eedc6 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:35.874859 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6af322bd-1a5e-4947-a43d-f132fe3eedc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:36.045473 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af322bd-1a5e-4947-a43d-f132fe3eedc6 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:36.124223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:36.168546 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d591440-07c2-4459-b238-c69d8e7eedf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:36.169325 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591440-07c2-4459-b238-c69d8e7eedf5 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:36.169502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591440-07c2-4459-b238-c69d8e7eedf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:36.169807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d591440-07c2-4459-b238-c69d8e7eedf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:36.172198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9d591440-07c2-4459-b238-c69d8e7eedf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:36.271667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d591440-07c2-4459-b238-c69d8e7eedf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:36.273381 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d591440-07c2-4459-b238-c69d8e7eedf5 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:36.297047 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 524/1037] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:38.786101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4986f-47ad-4215-9be3-4a112cc41412 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:38.790531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4986f-47ad-4215-9be3-4a112cc41412 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:38.790531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4986f-47ad-4215-9be3-4a112cc41412 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:38.790531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 514/1038] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:38.793863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7a344-1675-4b12-8360-900d0467a40f None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:38.794532 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7a344-1675-4b12-8360-900d0467a40f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:38.794532 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7a344-1675-4b12-8360-900d0467a40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:38.867183 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-34b7a344-1675-4b12-8360-900d0467a40f None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:38.868984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-34b7a344-1675-4b12-8360-900d0467a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:38.910061 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:38.975001 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 525/1039] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:39.268019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4986f-47ad-4215-9be3-4a112cc41412 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:39.269749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e9b4986f-47ad-4215-9be3-4a112cc41412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:39.345092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:39.443790 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4986f-47ad-4215-9be3-4a112cc41412 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:39.575350 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b62d23-5457-48b7-8e1c-957900904f92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:39.575350 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b62d23-5457-48b7-8e1c-957900904f92 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:39.576118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b62d23-5457-48b7-8e1c-957900904f92 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:39.576118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b62d23-5457-48b7-8e1c-957900904f92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:39.577913 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-35b62d23-5457-48b7-8e1c-957900904f92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:39.607546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:39.679409 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b62d23-5457-48b7-8e1c-957900904f92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:39.681097 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b62d23-5457-48b7-8e1c-957900904f92 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:39.701060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 515/1040] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:42.388614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865085f-08e9-4475-8a40-53099ffab60c None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:42.389521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865085f-08e9-4475-8a40-53099ffab60c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:42.389988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865085f-08e9-4475-8a40-53099ffab60c None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:42.391333 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 526/1041] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:42.396930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4faf77-b01b-49fd-a7de-2dceb29b8ebe None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:42.397409 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4faf77-b01b-49fd-a7de-2dceb29b8ebe None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:42.397707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4faf77-b01b-49fd-a7de-2dceb29b8ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:42.467870 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2f4faf77-b01b-49fd-a7de-2dceb29b8ebe None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:42.469112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2f4faf77-b01b-49fd-a7de-2dceb29b8ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:42.571793 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:42.577609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 516/1042] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:42.871030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340f0ab-52d2-4892-b1df-281c767569b8 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:42.871303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340f0ab-52d2-4892-b1df-281c767569b8 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:42.871577 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340f0ab-52d2-4892-b1df-281c767569b8 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:42.873042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 527/1043] 10.222.0.45 () {54 vars in 961 bytes} [Mon Oct 31 15:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:42.878930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bb2e4-a3d9-4a36-b2e4-12e80e864858 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:42.879388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bb2e4-a3d9-4a36-b2e4-12e80e864858 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:42.879735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bb2e4-a3d9-4a36-b2e4-12e80e864858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:42.963768 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-832bb2e4-a3d9-4a36-b2e4-12e80e864858 None None] MFA Rules not processed for user `9ec30e419d6f4fddb05c4bb08f2ce3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:42.964985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-832bb2e4-a3d9-4a36-b2e4-12e80e864858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:43.097306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 517/1044] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Oct 31 15:01:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:43.105371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340f0ab-52d2-4892-b1df-281c767569b8 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:43.106932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2340f0ab-52d2-4892-b1df-281c767569b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:43.267374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340f0ab-52d2-4892-b1df-281c767569b8 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:43.289101 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:43.395520 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491961e-76fb-4e9b-a2d2-337ba704d888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:43.396180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491961e-76fb-4e9b-a2d2-337ba704d888 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:43.396530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491961e-76fb-4e9b-a2d2-337ba704d888 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:43.396808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491961e-76fb-4e9b-a2d2-337ba704d888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:43.398441 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0491961e-76fb-4e9b-a2d2-337ba704d888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:43.451082 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e97e6-2c6f-478c-b20f-c02ab9e94379 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:43.451651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e97e6-2c6f-478c-b20f-c02ab9e94379 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:43.451651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e97e6-2c6f-478c-b20f-c02ab9e94379 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:43.453094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 518/1045] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 15:01:43.457962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed890e-b777-4ad4-8ee8-6cb9c2d9daee None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:43.458240 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed890e-b777-4ad4-8ee8-6cb9c2d9daee None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:43.458506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed890e-b777-4ad4-8ee8-6cb9c2d9daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:43.498057 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491961e-76fb-4e9b-a2d2-337ba704d888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:43.499899 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491961e-76fb-4e9b-a2d2-337ba704d888 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:43.521968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 528/1046] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:43.523451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:43.532888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-27ed890e-b777-4ad4-8ee8-6cb9c2d9daee None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:43.540452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-27ed890e-b777-4ad4-8ee8-6cb9c2d9daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:43.640458 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 519/1047] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:01:43.991830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903b76-2d14-4d93-b43f-17642b8c2604 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:43.992233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903b76-2d14-4d93-b43f-17642b8c2604 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:43.993113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f903b76-2d14-4d93-b43f-17642b8c2604 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:43.995261 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 529/1048] 10.222.0.45 () {54 vars in 963 bytes} [Mon Oct 31 15:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:44.000544 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f204ca6-08cd-4e45-a42c-2449e370cab7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:44.000911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f204ca6-08cd-4e45-a42c-2449e370cab7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:44.001335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f204ca6-08cd-4e45-a42c-2449e370cab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:44.087180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9f204ca6-08cd-4e45-a42c-2449e370cab7 None None] MFA Rules not processed for user `1277082583d64fc5a37d50f38393a51c`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:44.088748 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9f204ca6-08cd-4e45-a42c-2449e370cab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:44.167242 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:44.174748 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 520/1049] 10.222.0.45 () {58 vars in 1060 bytes} [Mon Oct 31 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:44.182590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f903b76-2d14-4d93-b43f-17642b8c2604 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:44.184192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2f903b76-2d14-4d93-b43f-17642b8c2604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:44.218329 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:44.301010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f903b76-2d14-4d93-b43f-17642b8c2604 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:44.385124 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d3953-445e-4c94-89bd-0b3f794871e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:44.385831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3953-445e-4c94-89bd-0b3f794871e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:44.386103 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3953-445e-4c94-89bd-0b3f794871e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:44.386364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3953-445e-4c94-89bd-0b3f794871e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:44.387956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c36d3953-445e-4c94-89bd-0b3f794871e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:44.473169 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:44.505851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d3953-445e-4c94-89bd-0b3f794871e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:44.507325 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d3953-445e-4c94-89bd-0b3f794871e0 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:44.528081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 530/1050] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:46.007066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddf39d-203e-439c-a915-59dbe85044ca None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:46.007573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddf39d-203e-439c-a915-59dbe85044ca None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:46.007678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddf39d-203e-439c-a915-59dbe85044ca None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:46.009008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 521/1051] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:46.014317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1542c1-2016-4b9e-88b9-f9897061f631 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:46.014741 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1542c1-2016-4b9e-88b9-f9897061f631 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:46.014836 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1542c1-2016-4b9e-88b9-f9897061f631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:46.083183 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-2f1542c1-2016-4b9e-88b9-f9897061f631 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:46.084401 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2f1542c1-2016-4b9e-88b9-f9897061f631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:46.187982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 531/1052] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:46.478111 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddf39d-203e-439c-a915-59dbe85044ca None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:46.479657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-46ddf39d-203e-439c-a915-59dbe85044ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:46.635237 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddf39d-203e-439c-a915-59dbe85044ca None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:46.705586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:46.759002 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d50eb7-910e-439e-9042-e1f5dbb33a21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:46.759730 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d50eb7-910e-439e-9042-e1f5dbb33a21 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:46.760035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d50eb7-910e-439e-9042-e1f5dbb33a21 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:46.760303 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d50eb7-910e-439e-9042-e1f5dbb33a21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:46.761928 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-86d50eb7-910e-439e-9042-e1f5dbb33a21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:46.859844 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d50eb7-910e-439e-9042-e1f5dbb33a21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:46.861985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d50eb7-910e-439e-9042-e1f5dbb33a21 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:46.880782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 522/1053] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:49.309228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db86960-d54c-446a-9c20-4d56be61f66f None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:49.309788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db86960-d54c-446a-9c20-4d56be61f66f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:49.309788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db86960-d54c-446a-9c20-4d56be61f66f None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:49.311221 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 532/1054] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:49.316352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b0d78-928c-41f9-82f1-c2eaaf580a71 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:49.316776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b0d78-928c-41f9-82f1-c2eaaf580a71 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:49.316961 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b0d78-928c-41f9-82f1-c2eaaf580a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:49.388449 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f03b0d78-928c-41f9-82f1-c2eaaf580a71 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:49.389689 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f03b0d78-928c-41f9-82f1-c2eaaf580a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:49.421237 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:49.492739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 523/1055] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:49.783106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db86960-d54c-446a-9c20-4d56be61f66f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:49.786513 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2db86960-d54c-446a-9c20-4d56be61f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:49.827121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:49.943350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db86960-d54c-446a-9c20-4d56be61f66f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:50.067491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:50.073821 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc7523-ac7a-4f49-aa32-9e9d39da153e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:50.074423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7523-ac7a-4f49-aa32-9e9d39da153e service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:50.074696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7523-ac7a-4f49-aa32-9e9d39da153e service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:50.074958 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7523-ac7a-4f49-aa32-9e9d39da153e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:50.076662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-79fc7523-ac7a-4f49-aa32-9e9d39da153e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:50.173997 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc7523-ac7a-4f49-aa32-9e9d39da153e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:50.175598 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc7523-ac7a-4f49-aa32-9e9d39da153e service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:50.195301 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 533/1056] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:52.576007 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f55c8-0704-443f-bdd6-5a686c011c9b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:52.576535 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f55c8-0704-443f-bdd6-5a686c011c9b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:52.576535 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f55c8-0704-443f-bdd6-5a686c011c9b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:52.578432 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 524/1057] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:52.583345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2dad-f5d4-450b-a645-ed9cf9d3632a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:52.583738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2dad-f5d4-450b-a645-ed9cf9d3632a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:52.583900 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc2dad-f5d4-450b-a645-ed9cf9d3632a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:52.654954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-35bc2dad-f5d4-450b-a645-ed9cf9d3632a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:52.656153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-35bc2dad-f5d4-450b-a645-ed9cf9d3632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:52.722904 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:52.758325 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 534/1058] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:53.074579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f55c8-0704-443f-bdd6-5a686c011c9b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:53.076614 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-242f55c8-0704-443f-bdd6-5a686c011c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:53.241768 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f55c8-0704-443f-bdd6-5a686c011c9b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:53.260237 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:53.376381 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661caeb-ed0e-444b-84e2-94d0b144c39b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:53.377026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661caeb-ed0e-444b-84e2-94d0b144c39b service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:53.377359 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661caeb-ed0e-444b-84e2-94d0b144c39b service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:53.377650 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661caeb-ed0e-444b-84e2-94d0b144c39b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:53.379364 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a661caeb-ed0e-444b-84e2-94d0b144c39b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:53.479789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661caeb-ed0e-444b-84e2-94d0b144c39b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:53.481455 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661caeb-ed0e-444b-84e2-94d0b144c39b service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:53.499982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 525/1059] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:55.865689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa817e37-efb2-4ca3-aecd-cbb1c6f7bf62 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:55.865689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa817e37-efb2-4ca3-aecd-cbb1c6f7bf62 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:55.865689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa817e37-efb2-4ca3-aecd-cbb1c6f7bf62 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:55.865689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 535/1060] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:55.871563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0efaf-c159-480e-806d-0abfb634b0ba None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:55.871971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0efaf-c159-480e-806d-0abfb634b0ba None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:55.872098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0efaf-c159-480e-806d-0abfb634b0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:55.901116 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:55.950788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-35a0efaf-c159-480e-806d-0abfb634b0ba None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:55.952458 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-35a0efaf-c159-480e-806d-0abfb634b0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:56.077538 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 526/1061] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:01:56.375636 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa817e37-efb2-4ca3-aecd-cbb1c6f7bf62 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:56.377180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-fa817e37-efb2-4ca3-aecd-cbb1c6f7bf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:56.542220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa817e37-efb2-4ca3-aecd-cbb1c6f7bf62 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:56.609527 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:56.686063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63dd2c7-347c-4686-9ded-1c057e59f217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:56.686847 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dd2c7-347c-4686-9ded-1c057e59f217 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:56.687176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dd2c7-347c-4686-9ded-1c057e59f217 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:56.687521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63dd2c7-347c-4686-9ded-1c057e59f217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:56.689800 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a63dd2c7-347c-4686-9ded-1c057e59f217 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:56.796150 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63dd2c7-347c-4686-9ded-1c057e59f217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:56.797696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63dd2c7-347c-4686-9ded-1c057e59f217 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:56.816491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 536/1062] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:01:59.048534 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a8c8e-f10f-42c4-af11-c3967953049d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:59.049055 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a8c8e-f10f-42c4-af11-c3967953049d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:59.049055 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a8c8e-f10f-42c4-af11-c3967953049d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:59.050695 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 527/1063] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:01:59.056635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b2a94-8216-4ee9-8e68-c9dee2773aa9 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:59.057149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b2a94-8216-4ee9-8e68-c9dee2773aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:59.057149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b2a94-8216-4ee9-8e68-c9dee2773aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:59.125703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-936b2a94-8216-4ee9-8e68-c9dee2773aa9 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:01:59.126904 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-936b2a94-8216-4ee9-8e68-c9dee2773aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:59.137200 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:59.230813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 537/1064] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:01:59.519896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a8c8e-f10f-42c4-af11-c3967953049d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:01:59.521475 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-053a8c8e-f10f-42c4-af11-c3967953049d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:59.612635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:59.667369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a8c8e-f10f-42c4-af11-c3967953049d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:01:59.779970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01744a51-d852-446b-9ce1-af9c58d47f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:01:59.780495 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01744a51-d852-446b-9ce1-af9c58d47f46 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:01:59.780829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01744a51-d852-446b-9ce1-af9c58d47f46 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:01:59.781101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01744a51-d852-446b-9ce1-af9c58d47f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:01:59.782709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-01744a51-d852-446b-9ce1-af9c58d47f46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:01:59.845565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:01:59.875773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01744a51-d852-446b-9ce1-af9c58d47f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:01:59.877482 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01744a51-d852-446b-9ce1-af9c58d47f46 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:01:59.896042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 528/1065] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:00.425746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4abb2-3689-4b5e-8189-835d89e1f083 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:00.426297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4abb2-3689-4b5e-8189-835d89e1f083 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:00.426297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4abb2-3689-4b5e-8189-835d89e1f083 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:00.427516 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 538/1066] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:00.433584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b93837-1b38-4dbd-b353-7c6fced2a74a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:00.434034 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b93837-1b38-4dbd-b353-7c6fced2a74a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:00.434141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b93837-1b38-4dbd-b353-7c6fced2a74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:00.500223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e8b93837-1b38-4dbd-b353-7c6fced2a74a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:00.501476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e8b93837-1b38-4dbd-b353-7c6fced2a74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:00.599559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 529/1067] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:00.904182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b998e-b6cf-4ea7-91b2-966b85836fd7 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:00.904462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b998e-b6cf-4ea7-91b2-966b85836fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:00.904734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b998e-b6cf-4ea7-91b2-966b85836fd7 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:00.906177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 539/1068] 10.222.0.45 () {54 vars in 962 bytes} [Mon Oct 31 15:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:00.911457 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cc8fc-6396-4bb1-b70d-efd2af112089 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:00.911826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cc8fc-6396-4bb1-b70d-efd2af112089 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:00.912159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cc8fc-6396-4bb1-b70d-efd2af112089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:00.958534 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:00.994306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-838cc8fc-6396-4bb1-b70d-efd2af112089 None None] MFA Rules not processed for user `74317ae6b47843de85d03f3a9d3a811d`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:00.995867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-838cc8fc-6396-4bb1-b70d-efd2af112089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:01.076282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 530/1069] 10.222.0.45 () {58 vars in 1059 bytes} [Mon Oct 31 15:02:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:01.084873 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b998e-b6cf-4ea7-91b2-966b85836fd7 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:01.087023 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-4f8b998e-b6cf-4ea7-91b2-966b85836fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:01.198065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b998e-b6cf-4ea7-91b2-966b85836fd7 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:01.238140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:01.274273 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349a8d7-f873-4040-b350-3744ad939c1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74317ae6b47843de85d03f3a9d3a811d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:01.274753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349a8d7-f873-4040-b350-3744ad939c1a service glance] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:01.275025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349a8d7-f873-4040-b350-3744ad939c1a service glance] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:01.275287 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349a8d7-f873-4040-b350-3744ad939c1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:01.276916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5349a8d7-f873-4040-b350-3744ad939c1a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:01.386976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349a8d7-f873-4040-b350-3744ad939c1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:01.388440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349a8d7-f873-4040-b350-3744ad939c1a service glance] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:01.407258 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 540/1070] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:02.352374 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2700b99-d25d-447c-a636-9e966efeff67 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:02.352883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2700b99-d25d-447c-a636-9e966efeff67 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:02.352981 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2700b99-d25d-447c-a636-9e966efeff67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:02.405890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7e163-537d-48d1-b2f1-c8e20dcf15e6 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:02.406486 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7e163-537d-48d1-b2f1-c8e20dcf15e6 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:02.406486 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7e163-537d-48d1-b2f1-c8e20dcf15e6 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:02.407784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 541/1071] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 15:02:02.412921 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50af03e-e6cd-4954-a89c-e70bd2888f1e None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:02.417922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50af03e-e6cd-4954-a89c-e70bd2888f1e None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:02.417922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50af03e-e6cd-4954-a89c-e70bd2888f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:02.422917 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f2700b99-d25d-447c-a636-9e966efeff67 None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:02.424122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f2700b99-d25d-447c-a636-9e966efeff67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:02.484245 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e50af03e-e6cd-4954-a89c-e70bd2888f1e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:02.485723 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e50af03e-e6cd-4954-a89c-e70bd2888f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:02.503345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:02.505740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:02.513675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 531/1072] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:02:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:02:02.560489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fab69-2ea4-45bd-8734-1bdef8097270 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:02.560769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fab69-2ea4-45bd-8734-1bdef8097270 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:02.561034 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5fab69-2ea4-45bd-8734-1bdef8097270 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:02.562526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 532/1073] 10.222.0.45 () {54 vars in 943 bytes} [Mon Oct 31 15:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 15:02:02.568539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb9ebe-b7ee-4408-86a7-185774442d02 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:02.568839 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb9ebe-b7ee-4408-86a7-185774442d02 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:02.569215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb9ebe-b7ee-4408-86a7-185774442d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:02.593236 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 542/1074] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:02:02.646030 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3aeb9ebe-b7ee-4408-86a7-185774442d02 None None] MFA Rules not processed for user `93cb8e24b84d4c26bf5fd58d93ebb6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:02.647309 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3aeb9ebe-b7ee-4408-86a7-185774442d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:02.752662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 533/1075] 10.222.0.45 () {58 vars in 1040 bytes} [Mon Oct 31 15:02:02 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:02.762481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50af03e-e6cd-4954-a89c-e70bd2888f1e None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:02.763754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e50af03e-e6cd-4954-a89c-e70bd2888f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:02.871874 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50af03e-e6cd-4954-a89c-e70bd2888f1e None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:02.879680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb9ebe-b7ee-4408-86a7-185774442d02 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:02.885364 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3aeb9ebe-b7ee-4408-86a7-185774442d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:02.924064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:02.935965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:02.980581 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb9ebe-b7ee-4408-86a7-185774442d02 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:02.981173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd5263-811a-4ea8-9fb2-184b5c3427f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:02.981866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd5263-811a-4ea8-9fb2-184b5c3427f9 service swift] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:02.982182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd5263-811a-4ea8-9fb2-184b5c3427f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:02.982766 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd5263-811a-4ea8-9fb2-184b5c3427f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:02.985394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e1dd5263-811a-4ea8-9fb2-184b5c3427f9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:03.070951 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd5263-811a-4ea8-9fb2-184b5c3427f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:03.072804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd5263-811a-4ea8-9fb2-184b5c3427f9 service swift] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:03.081364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 543/1076] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:02:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:02:03.098146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d30fea-16fd-4c0a-85b5-95b18665478b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:03.098762 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d30fea-16fd-4c0a-85b5-95b18665478b service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:03.099038 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d30fea-16fd-4c0a-85b5-95b18665478b service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:03.099310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d30fea-16fd-4c0a-85b5-95b18665478b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:03.100913 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c1d30fea-16fd-4c0a-85b5-95b18665478b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:03.166521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:03.192054 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d30fea-16fd-4c0a-85b5-95b18665478b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:03.193673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d30fea-16fd-4c0a-85b5-95b18665478b service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:03.211454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 534/1077] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:02:05.600198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf39e4-1e9f-4679-8138-5affc73e6886 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:05.600808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf39e4-1e9f-4679-8138-5affc73e6886 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:05.600808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf39e4-1e9f-4679-8138-5affc73e6886 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:05.606694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 544/1078] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:02:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:05.608100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9aecf-569a-41bd-8de8-a03980c3abc7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:05.608523 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9aecf-569a-41bd-8de8-a03980c3abc7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:05.608668 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9aecf-569a-41bd-8de8-a03980c3abc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:05.694503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e8b9aecf-569a-41bd-8de8-a03980c3abc7 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:05.695950 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e8b9aecf-569a-41bd-8de8-a03980c3abc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:05.806448 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 535/1079] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:06.096043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf39e4-1e9f-4679-8138-5affc73e6886 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:06.097805 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3fbf39e4-1e9f-4679-8138-5affc73e6886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:06.189672 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:06.270544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf39e4-1e9f-4679-8138-5affc73e6886 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:06.401184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed33de-72ed-4b00-b2ad-7257f3f3e01d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:06.401920 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed33de-72ed-4b00-b2ad-7257f3f3e01d service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:06.402198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed33de-72ed-4b00-b2ad-7257f3f3e01d service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:06.402466 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed33de-72ed-4b00-b2ad-7257f3f3e01d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:06.404108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2eed33de-72ed-4b00-b2ad-7257f3f3e01d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:06.454665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:06.505628 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed33de-72ed-4b00-b2ad-7257f3f3e01d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:06.507873 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed33de-72ed-4b00-b2ad-7257f3f3e01d service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:06.527714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 545/1080] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:08.914914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acc853-f41b-43b9-bb2c-6691ccb55340 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:08.915529 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acc853-f41b-43b9-bb2c-6691ccb55340 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:08.915645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acc853-f41b-43b9-bb2c-6691ccb55340 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:08.917182 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 536/1081] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:08.922293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4621459-69c3-40a1-9b6d-763e0a11b03e None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:08.922691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4621459-69c3-40a1-9b6d-763e0a11b03e None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:08.922830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4621459-69c3-40a1-9b6d-763e0a11b03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:09.001504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-b4621459-69c3-40a1-9b6d-763e0a11b03e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:09.002740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b4621459-69c3-40a1-9b6d-763e0a11b03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:09.136117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 546/1082] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:09.457776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acc853-f41b-43b9-bb2c-6691ccb55340 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:09.457776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-57acc853-f41b-43b9-bb2c-6691ccb55340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:09.502140 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:09.630186 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acc853-f41b-43b9-bb2c-6691ccb55340 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:09.761175 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d950b-8f00-460c-9c5f-9ac599bca1ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:09.761792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d950b-8f00-460c-9c5f-9ac599bca1ec service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:09.762088 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d950b-8f00-460c-9c5f-9ac599bca1ec service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:09.762338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d950b-8f00-460c-9c5f-9ac599bca1ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:09.763973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d66d950b-8f00-460c-9c5f-9ac599bca1ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:09.865323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d950b-8f00-460c-9c5f-9ac599bca1ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:09.868076 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d950b-8f00-460c-9c5f-9ac599bca1ec service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:09.887430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 537/1083] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:09.895670 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:12.237571 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668cd85-3c68-48b2-9a0b-dfdfea7091e3 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:12.238080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668cd85-3c68-48b2-9a0b-dfdfea7091e3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:12.238080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668cd85-3c68-48b2-9a0b-dfdfea7091e3 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:12.243963 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 547/1084] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:02:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:12.245309 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e1e7-e0d4-4e6f-8df2-f6e3d562e843 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:12.245720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e1e7-e0d4-4e6f-8df2-f6e3d562e843 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:12.245860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21e1e7-e0d4-4e6f-8df2-f6e3d562e843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:12.320564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ee21e1e7-e0d4-4e6f-8df2-f6e3d562e843 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:12.325884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ee21e1e7-e0d4-4e6f-8df2-f6e3d562e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:12.402392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:12.428520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 538/1085] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:12.728844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668cd85-3c68-48b2-9a0b-dfdfea7091e3 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:12.730427 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f668cd85-3c68-48b2-9a0b-dfdfea7091e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:12.753066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:12.892726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668cd85-3c68-48b2-9a0b-dfdfea7091e3 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:12.996369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:13.020597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ceebf-870d-44e7-b029-654482153ed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:13.025156 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ceebf-870d-44e7-b029-654482153ed2 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:13.025156 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ceebf-870d-44e7-b029-654482153ed2 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:13.025156 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ceebf-870d-44e7-b029-654482153ed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:13.025156 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-fb1ceebf-870d-44e7-b029-654482153ed2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:13.127889 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ceebf-870d-44e7-b029-654482153ed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:13.129493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ceebf-870d-44e7-b029-654482153ed2 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:13.151665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 548/1086] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:22.503970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=9 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:23.150351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=54 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:27.378383 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c00d48-a737-4f6a-a105-626aa0c80288 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:27.378957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c00d48-a737-4f6a-a105-626aa0c80288 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:27.378957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c00d48-a737-4f6a-a105-626aa0c80288 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:27.380245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 539/1087] 10.222.0.45 () {54 vars in 918 bytes} [Mon Oct 31 15:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:27.385600 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c6476-e794-4b5e-a62a-c8c56f96e2fc None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:27.386016 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c6476-e794-4b5e-a62a-c8c56f96e2fc None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:27.386143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c6476-e794-4b5e-a62a-c8c56f96e2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:27.462280 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-9c2c6476-e794-4b5e-a62a-c8c56f96e2fc None None] MFA Rules not processed for user `77b43d235d0441b3b8a272d051b54ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:27.463517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9c2c6476-e794-4b5e-a62a-c8c56f96e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:27.569547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 549/1088] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Oct 31 15:02:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:27.583691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea539a-8c4e-4cb1-93d4-4da063425676 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:27.584049 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea539a-8c4e-4cb1-93d4-4da063425676 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:27.584316 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea539a-8c4e-4cb1-93d4-4da063425676 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:27.585752 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 540/1089] 10.222.0.45 () {54 vars in 918 bytes} [Mon Oct 31 15:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:27.590334 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c282e62-aae5-4319-a14a-f15598d3cdba None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:27.590615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c282e62-aae5-4319-a14a-f15598d3cdba None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:27.590884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c282e62-aae5-4319-a14a-f15598d3cdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:27.664617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:27.667592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-3c282e62-aae5-4319-a14a-f15598d3cdba None None] MFA Rules not processed for user `9ec30e419d6f4fddb05c4bb08f2ce3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:27.668793 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3c282e62-aae5-4319-a14a-f15598d3cdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:27.784027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 550/1090] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Oct 31 15:02:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:30.334949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053a8ab-90de-448d-9663-a0f8d2113521 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:30.335512 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053a8ab-90de-448d-9663-a0f8d2113521 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:30.335623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053a8ab-90de-448d-9663-a0f8d2113521 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:30.336900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 541/1091] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:30.342094 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6522c-add0-4ffa-aeb3-7024df30e720 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:30.342493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6522c-add0-4ffa-aeb3-7024df30e720 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:30.342655 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6522c-add0-4ffa-aeb3-7024df30e720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:30.409835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-7ce6522c-add0-4ffa-aeb3-7024df30e720 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:30.411032 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7ce6522c-add0-4ffa-aeb3-7024df30e720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:30.466041 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:30.507611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 551/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:30.796435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053a8ab-90de-448d-9663-a0f8d2113521 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:30.796435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3053a8ab-90de-448d-9663-a0f8d2113521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:30.940552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053a8ab-90de-448d-9663-a0f8d2113521 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:31.013539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:31.054629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1f0af-0e37-447e-9e14-c9840fba89ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:31.055224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1f0af-0e37-447e-9e14-c9840fba89ce service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:31.055498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1f0af-0e37-447e-9e14-c9840fba89ce service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:31.055759 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1f0af-0e37-447e-9e14-c9840fba89ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:31.057363 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0eb1f0af-0e37-447e-9e14-c9840fba89ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:31.149834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1f0af-0e37-447e-9e14-c9840fba89ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:31.151991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1f0af-0e37-447e-9e14-c9840fba89ce service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:31.171391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 542/1093] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:32.305963 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1061bc2-445f-494b-a7a9-936cd16c1932 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:32.306495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1061bc2-445f-494b-a7a9-936cd16c1932 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:32.306495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1061bc2-445f-494b-a7a9-936cd16c1932 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:32.307754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 552/1094] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 15:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:32.312787 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc735f-f6e0-478e-956d-431491b135d0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:32.313179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc735f-f6e0-478e-956d-431491b135d0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:32.313359 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc735f-f6e0-478e-956d-431491b135d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:32.388572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cabc735f-f6e0-478e-956d-431491b135d0 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:32.389809 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cabc735f-f6e0-478e-956d-431491b135d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:32.418045 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:32.485678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 543/1095] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 15:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:32.644233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1061bc2-445f-494b-a7a9-936cd16c1932 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:32.645842 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b1061bc2-445f-494b-a7a9-936cd16c1932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:32.790354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1061bc2-445f-494b-a7a9-936cd16c1932 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:32.832350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:32.905230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455150e-1240-402d-a548-e659f5379f44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:32.905781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455150e-1240-402d-a548-e659f5379f44 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:32.906055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455150e-1240-402d-a548-e659f5379f44 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:32.906320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455150e-1240-402d-a548-e659f5379f44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:32.907923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c455150e-1240-402d-a548-e659f5379f44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:33.000839 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455150e-1240-402d-a548-e659f5379f44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:33.002458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455150e-1240-402d-a548-e659f5379f44 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:33.020758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 553/1096] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:34.138025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c6ab-d413-4586-84fc-1e570bcf8d08 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:34.138536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c6ab-d413-4586-84fc-1e570bcf8d08 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:34.138536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438c6ab-d413-4586-84fc-1e570bcf8d08 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:34.139825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 544/1097] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 15:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:34.144600 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc0c58-7efa-47bc-9a44-0063494b995f None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:34.145049 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc0c58-7efa-47bc-9a44-0063494b995f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:34.145144 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc0c58-7efa-47bc-9a44-0063494b995f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:34.199884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:34.221246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-3fcc0c58-7efa-47bc-9a44-0063494b995f None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:34.222464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3fcc0c58-7efa-47bc-9a44-0063494b995f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:34.321633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 554/1098] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 15:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:34.477365 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438c6ab-d413-4586-84fc-1e570bcf8d08 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:34.478808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3438c6ab-d413-4586-84fc-1e570bcf8d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:34.622504 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438c6ab-d413-4586-84fc-1e570bcf8d08 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:34.634601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:34.735164 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85fee7-51cc-4d70-9e8d-fdec296ccb42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:34.735686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85fee7-51cc-4d70-9e8d-fdec296ccb42 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:34.735968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85fee7-51cc-4d70-9e8d-fdec296ccb42 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:34.736226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85fee7-51cc-4d70-9e8d-fdec296ccb42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:34.737832 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0d85fee7-51cc-4d70-9e8d-fdec296ccb42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:34.826180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85fee7-51cc-4d70-9e8d-fdec296ccb42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:34.827783 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85fee7-51cc-4d70-9e8d-fdec296ccb42 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:34.845815 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 545/1099] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:35.948148 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd72d8-4a42-41d8-9a7c-1e2114c7d81f None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:35.948714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd72d8-4a42-41d8-9a7c-1e2114c7d81f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:35.948714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd72d8-4a42-41d8-9a7c-1e2114c7d81f None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:35.950098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 555/1100] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 15:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:35.954970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb5737-ee38-4342-8d48-242046cee3bf None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:35.955360 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb5737-ee38-4342-8d48-242046cee3bf None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:35.955533 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb5737-ee38-4342-8d48-242046cee3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:35.975498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:36.031802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-21cb5737-ee38-4342-8d48-242046cee3bf None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:36.032999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-21cb5737-ee38-4342-8d48-242046cee3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:36.127011 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 546/1101] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 15:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:36.277334 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd72d8-4a42-41d8-9a7c-1e2114c7d81f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:36.278850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-dbdd72d8-4a42-41d8-9a7c-1e2114c7d81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:36.388957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:36.426318 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd72d8-4a42-41d8-9a7c-1e2114c7d81f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:36.538166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7c67a-0e40-4681-8248-2cec6423fd5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:36.539013 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7c67a-0e40-4681-8248-2cec6423fd5c service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:36.539281 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7c67a-0e40-4681-8248-2cec6423fd5c service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:36.539542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7c67a-0e40-4681-8248-2cec6423fd5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:36.541182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a6f7c67a-0e40-4681-8248-2cec6423fd5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:36.619497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:36.632530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7c67a-0e40-4681-8248-2cec6423fd5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:36.634146 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7c67a-0e40-4681-8248-2cec6423fd5c service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:36.652454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 556/1102] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:37.760059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ae06f-c01f-4a56-8f5c-e549c01e19db None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:37.760622 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ae06f-c01f-4a56-8f5c-e549c01e19db None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:37.760622 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ae06f-c01f-4a56-8f5c-e549c01e19db None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:37.761980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 547/1103] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 15:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:37.766922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2460d-249b-4291-ad3c-e61e65f3c64b None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:37.767483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2460d-249b-4291-ad3c-e61e65f3c64b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:37.767483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2460d-249b-4291-ad3c-e61e65f3c64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:37.847025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-44c2460d-249b-4291-ad3c-e61e65f3c64b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:37.848285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-44c2460d-249b-4291-ad3c-e61e65f3c64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:37.963643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 557/1104] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 15:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:38.120396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ae06f-c01f-4a56-8f5c-e549c01e19db None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:38.121961 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7b3ae06f-c01f-4a56-8f5c-e549c01e19db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:38.210127 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:38.283655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ae06f-c01f-4a56-8f5c-e549c01e19db None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:38.426085 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f2a89-fd88-4a69-a431-1fa590a29a03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:38.426613 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2a89-fd88-4a69-a431-1fa590a29a03 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:38.426888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2a89-fd88-4a69-a431-1fa590a29a03 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:38.427165 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2a89-fd88-4a69-a431-1fa590a29a03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:38.429304 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2e5f2a89-fd88-4a69-a431-1fa590a29a03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:38.483064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:38.525146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f2a89-fd88-4a69-a431-1fa590a29a03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:38.526745 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f2a89-fd88-4a69-a431-1fa590a29a03 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:38.545221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 548/1105] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:39.876723 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71dcd8-03d1-438a-b433-5015663361a5 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:39.877189 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71dcd8-03d1-438a-b433-5015663361a5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:39.877321 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71dcd8-03d1-438a-b433-5015663361a5 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:39.878777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 558/1106] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 15:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:39.883933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d420aab-cbaf-498c-b5aa-043a5e058b40 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:39.884347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d420aab-cbaf-498c-b5aa-043a5e058b40 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:39.884459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d420aab-cbaf-498c-b5aa-043a5e058b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:39.959173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3d420aab-cbaf-498c-b5aa-043a5e058b40 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:39.961036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3d420aab-cbaf-498c-b5aa-043a5e058b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:40.057423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 549/1107] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 15:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:40.205803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71dcd8-03d1-438a-b433-5015663361a5 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:40.207258 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-dd71dcd8-03d1-438a-b433-5015663361a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:40.255498 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:40.352766 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71dcd8-03d1-438a-b433-5015663361a5 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:40.463828 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47e9e4-05f0-41c0-95ad-dbf704f3578e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:40.464349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47e9e4-05f0-41c0-95ad-dbf704f3578e service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:40.464623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47e9e4-05f0-41c0-95ad-dbf704f3578e service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:40.464884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47e9e4-05f0-41c0-95ad-dbf704f3578e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:40.466491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-bc47e9e4-05f0-41c0-95ad-dbf704f3578e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:40.473216 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:40.557048 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47e9e4-05f0-41c0-95ad-dbf704f3578e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:40.558715 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47e9e4-05f0-41c0-95ad-dbf704f3578e service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:40.576814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 559/1108] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:41.672508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b14829-2531-4637-afe5-39c4efeb9ea9 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:41.673085 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b14829-2531-4637-afe5-39c4efeb9ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:41.673085 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b14829-2531-4637-afe5-39c4efeb9ea9 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:41.674441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 550/1109] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 15:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:41.680141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24556f68-8b97-4459-8ec2-0bed528286ca None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:41.680573 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24556f68-8b97-4459-8ec2-0bed528286ca None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:41.680668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24556f68-8b97-4459-8ec2-0bed528286ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:41.754253 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-24556f68-8b97-4459-8ec2-0bed528286ca None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:41.755451 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-24556f68-8b97-4459-8ec2-0bed528286ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:41.823076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:41.852158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 560/1110] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 15:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:42.002202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b14829-2531-4637-afe5-39c4efeb9ea9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:42.003717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-68b14829-2531-4637-afe5-39c4efeb9ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:42.021860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:42.147968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b14829-2531-4637-afe5-39c4efeb9ea9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:42.233644 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:42.259679 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cfea8-e184-4aa3-bf0c-9bad48604fdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:42.260280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cfea8-e184-4aa3-bf0c-9bad48604fdd service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:42.260555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cfea8-e184-4aa3-bf0c-9bad48604fdd service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:42.260824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cfea8-e184-4aa3-bf0c-9bad48604fdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:42.262445 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-247cfea8-e184-4aa3-bf0c-9bad48604fdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:42.351567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cfea8-e184-4aa3-bf0c-9bad48604fdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:42.353135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cfea8-e184-4aa3-bf0c-9bad48604fdd service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:42.371162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 551/1111] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:43.486870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf330d-0b70-42e1-9927-d40aedd943d1 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:43.487441 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf330d-0b70-42e1-9927-d40aedd943d1 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:43.487441 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf330d-0b70-42e1-9927-d40aedd943d1 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:43.488799 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 561/1112] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 15:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:43.494097 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83234475-0e98-4655-97be-a324b9124f4b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:43.494507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83234475-0e98-4655-97be-a324b9124f4b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:43.494629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83234475-0e98-4655-97be-a324b9124f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:43.569356 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-83234475-0e98-4655-97be-a324b9124f4b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:43.570544 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-83234475-0e98-4655-97be-a324b9124f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:43.610354 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:43.664896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 552/1113] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 15:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:43.813710 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf330d-0b70-42e1-9927-d40aedd943d1 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:43.815172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-94cf330d-0b70-42e1-9927-d40aedd943d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:43.960332 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf330d-0b70-42e1-9927-d40aedd943d1 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:44.014829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:44.074510 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaacbeb-8646-4e1c-a417-e6d86203d85c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:44.075110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaacbeb-8646-4e1c-a417-e6d86203d85c service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:44.075379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaacbeb-8646-4e1c-a417-e6d86203d85c service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:44.075641 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaacbeb-8646-4e1c-a417-e6d86203d85c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:44.077254 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5eaacbeb-8646-4e1c-a417-e6d86203d85c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:44.167313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaacbeb-8646-4e1c-a417-e6d86203d85c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:44.168907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaacbeb-8646-4e1c-a417-e6d86203d85c service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:44.187495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 562/1114] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:45.283367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cdfb1-12d2-4fce-8d37-ea7a36059264 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:45.283907 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cdfb1-12d2-4fce-8d37-ea7a36059264 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:45.283907 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cdfb1-12d2-4fce-8d37-ea7a36059264 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:45.285174 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 553/1115] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 15:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:45.290721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f422f-9591-4eec-81b9-98faa8300f1f None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:45.291176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f422f-9591-4eec-81b9-98faa8300f1f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:45.291273 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f422f-9591-4eec-81b9-98faa8300f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:45.369799 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-2f5f422f-9591-4eec-81b9-98faa8300f1f None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:45.371045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2f5f422f-9591-4eec-81b9-98faa8300f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:45.373137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:45.467121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 563/1116] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 15:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:45.618477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cdfb1-12d2-4fce-8d37-ea7a36059264 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:45.619990 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f45cdfb1-12d2-4fce-8d37-ea7a36059264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:45.762588 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cdfb1-12d2-4fce-8d37-ea7a36059264 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:45.791159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:45.875527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fcb0f-d43d-4fb7-9288-3d7fdb659ecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:45.876093 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fcb0f-d43d-4fb7-9288-3d7fdb659ecc service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:45.876369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fcb0f-d43d-4fb7-9288-3d7fdb659ecc service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:45.876637 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fcb0f-d43d-4fb7-9288-3d7fdb659ecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:45.878251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-418fcb0f-d43d-4fb7-9288-3d7fdb659ecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:45.967521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fcb0f-d43d-4fb7-9288-3d7fdb659ecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:45.969139 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fcb0f-d43d-4fb7-9288-3d7fdb659ecc service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:45.987933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 554/1117] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:48.043717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b170e-8e29-405b-a8e2-f69969a95df3 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:48.044293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b170e-8e29-405b-a8e2-f69969a95df3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:48.044293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b170e-8e29-405b-a8e2-f69969a95df3 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:48.045633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 564/1118] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:48.050904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3710-e24f-4538-ba96-56b00aeec718 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:48.051347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3710-e24f-4538-ba96-56b00aeec718 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:48.051453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3710-e24f-4538-ba96-56b00aeec718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:48.093387 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:48.118465 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0b6b3710-e24f-4538-ba96-56b00aeec718 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:48.119643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0b6b3710-e24f-4538-ba96-56b00aeec718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:48.215559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 555/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:48.502748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b170e-8e29-405b-a8e2-f69969a95df3 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:48.504342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ec6b170e-8e29-405b-a8e2-f69969a95df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:48.606930 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b170e-8e29-405b-a8e2-f69969a95df3 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:48.639581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:48.682250 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6cc0-031f-4c36-88e0-0067895f1d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:48.682856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6cc0-031f-4c36-88e0-0067895f1d16 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:48.683126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6cc0-031f-4c36-88e0-0067895f1d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:48.683386 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6cc0-031f-4c36-88e0-0067895f1d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:48.684965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-93aa6cc0-031f-4c36-88e0-0067895f1d16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:48.793480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6cc0-031f-4c36-88e0-0067895f1d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:48.794831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6cc0-031f-4c36-88e0-0067895f1d16 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:48.812787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 565/1120] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:51.117835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc4726-5258-434c-9632-b0e9ae7ae11d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:51.118397 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc4726-5258-434c-9632-b0e9ae7ae11d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:51.118397 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc4726-5258-434c-9632-b0e9ae7ae11d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:51.119713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 556/1121] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:51.125049 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc3721-2d5c-46b6-9103-02d93aa9f20d None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:51.125511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc3721-2d5c-46b6-9103-02d93aa9f20d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:51.125624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc3721-2d5c-46b6-9103-02d93aa9f20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:51.191563 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0cfc3721-2d5c-46b6-9103-02d93aa9f20d None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:51.192781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0cfc3721-2d5c-46b6-9103-02d93aa9f20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:51.205966 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:51.289605 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 566/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:51.575816 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc4726-5258-434c-9632-b0e9ae7ae11d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:51.577356 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3ddc4726-5258-434c-9632-b0e9ae7ae11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:51.679247 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc4726-5258-434c-9632-b0e9ae7ae11d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:51.691795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:51.751523 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b999f-011a-449e-9b4f-2fd5c5bb61d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:51.752115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b999f-011a-449e-9b4f-2fd5c5bb61d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:51.752387 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b999f-011a-449e-9b4f-2fd5c5bb61d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:51.752652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b999f-011a-449e-9b4f-2fd5c5bb61d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:51.754252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-385b999f-011a-449e-9b4f-2fd5c5bb61d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:51.864492 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b999f-011a-449e-9b4f-2fd5c5bb61d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:51.866140 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b999f-011a-449e-9b4f-2fd5c5bb61d3 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:51.884057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 557/1123] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:54.417154 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480b6f5-cb12-4fd7-aed1-8359788d7be8 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:54.417750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480b6f5-cb12-4fd7-aed1-8359788d7be8 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:54.417750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480b6f5-cb12-4fd7-aed1-8359788d7be8 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:54.419053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 567/1124] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:54.424270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67663053-147d-4696-b9d4-1bc0beb35a06 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:54.424672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67663053-147d-4696-b9d4-1bc0beb35a06 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:54.424792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67663053-147d-4696-b9d4-1bc0beb35a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:54.473100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:54.491663 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-67663053-147d-4696-b9d4-1bc0beb35a06 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:54.492876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-67663053-147d-4696-b9d4-1bc0beb35a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:54.587255 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 558/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:54.869359 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480b6f5-cb12-4fd7-aed1-8359788d7be8 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:54.870911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6480b6f5-cb12-4fd7-aed1-8359788d7be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:54.978627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480b6f5-cb12-4fd7-aed1-8359788d7be8 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:55.019916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:55.054994 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b40ff7-4f6c-45ea-bf97-c3ec217f77e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:55.055589 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b40ff7-4f6c-45ea-bf97-c3ec217f77e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:55.055859 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b40ff7-4f6c-45ea-bf97-c3ec217f77e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:55.056122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b40ff7-4f6c-45ea-bf97-c3ec217f77e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:55.057724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-17b40ff7-4f6c-45ea-bf97-c3ec217f77e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:55.168393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b40ff7-4f6c-45ea-bf97-c3ec217f77e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:55.169780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b40ff7-4f6c-45ea-bf97-c3ec217f77e7 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:55.187587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 568/1126] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:02:57.451162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cdabf-e616-4f51-ab7c-c34a17db1c50 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:57.451704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cdabf-e616-4f51-ab7c-c34a17db1c50 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:57.451704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cdabf-e616-4f51-ab7c-c34a17db1c50 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:57.453024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 559/1127] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:02:57.458303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4868d-f609-481e-9224-815ecb5ecf4a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:57.458708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4868d-f609-481e-9224-815ecb5ecf4a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:57.459673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4868d-f609-481e-9224-815ecb5ecf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:57.525265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-a6c4868d-f609-481e-9224-815ecb5ecf4a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:02:57.526489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a6c4868d-f609-481e-9224-815ecb5ecf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:57.547195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:57.622777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 569/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:02:57.910165 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cdabf-e616-4f51-ab7c-c34a17db1c50 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:02:57.911758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-501cdabf-e616-4f51-ab7c-c34a17db1c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:58.019228 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cdabf-e616-4f51-ab7c-c34a17db1c50 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:02:58.040011 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:02:58.092618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d06e8-ec39-4aed-ba1b-1296b7d92dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:02:58.094868 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d06e8-ec39-4aed-ba1b-1296b7d92dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:02:58.094868 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d06e8-ec39-4aed-ba1b-1296b7d92dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:02:58.094868 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d06e8-ec39-4aed-ba1b-1296b7d92dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:02:58.095388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e74d06e8-ec39-4aed-ba1b-1296b7d92dd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:02:58.204993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d06e8-ec39-4aed-ba1b-1296b7d92dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:02:58.206382 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d06e8-ec39-4aed-ba1b-1296b7d92dd0 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:02:58.223922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 560/1129] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:00.420412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0231978-9e36-4141-975b-535cf8ef177c None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:00.420993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0231978-9e36-4141-975b-535cf8ef177c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:00.420993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0231978-9e36-4141-975b-535cf8ef177c None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:00.422390 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 570/1130] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:00.427733 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77453021-3358-4979-9ede-1f3167328043 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:00.428125 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77453021-3358-4979-9ede-1f3167328043 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:00.428279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77453021-3358-4979-9ede-1f3167328043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:00.491115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:00.493808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-77453021-3358-4979-9ede-1f3167328043 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:00.495007 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-77453021-3358-4979-9ede-1f3167328043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:00.590008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 561/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:00.876417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0231978-9e36-4141-975b-535cf8ef177c None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:00.877979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a0231978-9e36-4141-975b-535cf8ef177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:00.982611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0231978-9e36-4141-975b-535cf8ef177c None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:01.032892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:01.057463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0a0b2-5d4c-4a96-8189-6973a8b9beaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:01.058061 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0a0b2-5d4c-4a96-8189-6973a8b9beaf service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:01.058336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0a0b2-5d4c-4a96-8189-6973a8b9beaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:01.058604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0a0b2-5d4c-4a96-8189-6973a8b9beaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:01.060175 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c3f0a0b2-5d4c-4a96-8189-6973a8b9beaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:01.173889 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0a0b2-5d4c-4a96-8189-6973a8b9beaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:01.175316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0a0b2-5d4c-4a96-8189-6973a8b9beaf service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:01.193828 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 571/1132] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:03.392093 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9c7bc-194a-4916-97a1-7d0383814c73 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:03.392664 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9c7bc-194a-4916-97a1-7d0383814c73 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:03.392664 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9c7bc-194a-4916-97a1-7d0383814c73 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:03.394054 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 562/1133] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:03.399937 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8d0a9-b7e1-4c27-8c39-2ad9e9d3cd29 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:03.400395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8d0a9-b7e1-4c27-8c39-2ad9e9d3cd29 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:03.400507 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8d0a9-b7e1-4c27-8c39-2ad9e9d3cd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:03.466435 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-10c8d0a9-b7e1-4c27-8c39-2ad9e9d3cd29 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:03.467646 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-10c8d0a9-b7e1-4c27-8c39-2ad9e9d3cd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:03.496479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:03.563628 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 572/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:03.846211 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9c7bc-194a-4916-97a1-7d0383814c73 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:03.847768 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c0d9c7bc-194a-4916-97a1-7d0383814c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:03.953391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9c7bc-194a-4916-97a1-7d0383814c73 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:03.984595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:04.030196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b240b-3e83-45a2-aa69-8074c4738c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:04.030801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b240b-3e83-45a2-aa69-8074c4738c20 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:04.031078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b240b-3e83-45a2-aa69-8074c4738c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:04.031347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b240b-3e83-45a2-aa69-8074c4738c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:04.033003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bd0b240b-3e83-45a2-aa69-8074c4738c20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:04.146866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b240b-3e83-45a2-aa69-8074c4738c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:04.148327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b240b-3e83-45a2-aa69-8074c4738c20 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:04.166560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 563/1135] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:06.359242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679c2bd-9368-4ceb-b5e7-e467adb0e11f None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:06.359797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679c2bd-9368-4ceb-b5e7-e467adb0e11f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:06.359797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679c2bd-9368-4ceb-b5e7-e467adb0e11f None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:06.361119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 573/1136] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:06.366911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aa248-5c7a-46aa-aae6-518593d5e71c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:06.367338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aa248-5c7a-46aa-aae6-518593d5e71c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:06.367440 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aa248-5c7a-46aa-aae6-518593d5e71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:06.431637 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-df3aa248-5c7a-46aa-aae6-518593d5e71c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:06.432825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-df3aa248-5c7a-46aa-aae6-518593d5e71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:06.440965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:06.526547 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 564/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:06.807823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679c2bd-9368-4ceb-b5e7-e467adb0e11f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:06.809366 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d679c2bd-9368-4ceb-b5e7-e467adb0e11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:06.910806 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679c2bd-9368-4ceb-b5e7-e467adb0e11f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:06.966820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:06.985465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb9d4a-81c1-47ad-bd02-3de47daa2dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:06.986070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb9d4a-81c1-47ad-bd02-3de47daa2dfa service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:06.986343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb9d4a-81c1-47ad-bd02-3de47daa2dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:06.986608 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb9d4a-81c1-47ad-bd02-3de47daa2dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:06.988216 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-16bb9d4a-81c1-47ad-bd02-3de47daa2dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:07.097020 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb9d4a-81c1-47ad-bd02-3de47daa2dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:07.098519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb9d4a-81c1-47ad-bd02-3de47daa2dfa service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:07.118305 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 574/1138] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:09.307823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d88ce-a290-42dd-b62a-e87138ad132c None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:09.308393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d88ce-a290-42dd-b62a-e87138ad132c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:09.308393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d88ce-a290-42dd-b62a-e87138ad132c None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:09.309641 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 565/1139] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:09.315121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef3433-1e24-43d9-b948-59e9959b6a4b None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:09.315533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef3433-1e24-43d9-b948-59e9959b6a4b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:09.315665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef3433-1e24-43d9-b948-59e9959b6a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:09.381574 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-adef3433-1e24-43d9-b948-59e9959b6a4b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:09.382750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-adef3433-1e24-43d9-b948-59e9959b6a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:09.420914 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:09.477928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 575/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:09.762926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d88ce-a290-42dd-b62a-e87138ad132c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:09.764450 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-396d88ce-a290-42dd-b62a-e87138ad132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:09.865999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d88ce-a290-42dd-b62a-e87138ad132c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:09.904014 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:09.939905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca701d-743c-496a-bb1a-3cc913c97e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:09.940510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca701d-743c-496a-bb1a-3cc913c97e95 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:09.940789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca701d-743c-496a-bb1a-3cc913c97e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:09.941059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca701d-743c-496a-bb1a-3cc913c97e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:09.942738 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-97ca701d-743c-496a-bb1a-3cc913c97e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:10.051578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca701d-743c-496a-bb1a-3cc913c97e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:10.052928 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca701d-743c-496a-bb1a-3cc913c97e95 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:10.071240 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 566/1141] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:12.235304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae819-e6a3-4d4e-810c-f39c62ea2560 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:12.235825 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae819-e6a3-4d4e-810c-f39c62ea2560 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:12.235825 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bae819-e6a3-4d4e-810c-f39c62ea2560 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:12.237073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 576/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:12.243119 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bed87-d6ad-444e-ba7c-f96bccf5fa57 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:12.243556 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bed87-d6ad-444e-ba7c-f96bccf5fa57 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:12.243665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bed87-d6ad-444e-ba7c-f96bccf5fa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:12.309598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d91bed87-d6ad-444e-ba7c-f96bccf5fa57 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:12.310796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d91bed87-d6ad-444e-ba7c-f96bccf5fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:12.329013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:12.406809 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 567/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:12.687231 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bae819-e6a3-4d4e-810c-f39c62ea2560 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:12.688773 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-95bae819-e6a3-4d4e-810c-f39c62ea2560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:12.790428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bae819-e6a3-4d4e-810c-f39c62ea2560 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:12.856242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:12.862851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c4dd5-d516-4dcc-ab85-1fd0c46f0dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:12.863477 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4dd5-d516-4dcc-ab85-1fd0c46f0dbe service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:12.863752 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4dd5-d516-4dcc-ab85-1fd0c46f0dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:12.864020 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c4dd5-d516-4dcc-ab85-1fd0c46f0dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:12.865697 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-bd4c4dd5-d516-4dcc-ab85-1fd0c46f0dbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:12.973791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c4dd5-d516-4dcc-ab85-1fd0c46f0dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:12.975730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c4dd5-d516-4dcc-ab85-1fd0c46f0dbe service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:12.993575 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 577/1144] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:15.157581 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b66a8-d821-4d28-b463-d819fffb9e20 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:15.158150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b66a8-d821-4d28-b463-d819fffb9e20 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:15.158150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b66a8-d821-4d28-b463-d819fffb9e20 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:15.159493 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 568/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:15.165607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eeadfb-7503-4933-b562-ecea9b9d5290 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:15.166042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eeadfb-7503-4933-b562-ecea9b9d5290 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:15.166134 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eeadfb-7503-4933-b562-ecea9b9d5290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:15.231797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f1eeadfb-7503-4933-b562-ecea9b9d5290 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:15.232971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f1eeadfb-7503-4933-b562-ecea9b9d5290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:15.282446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:15.332430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 578/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:15.620309 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b66a8-d821-4d28-b463-d819fffb9e20 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:15.621867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7c7b66a8-d821-4d28-b463-d819fffb9e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:15.724699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b66a8-d821-4d28-b463-d819fffb9e20 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:15.771528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:15.796694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58421f24-b08f-4c48-a9cf-5041ebef5f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:15.797317 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58421f24-b08f-4c48-a9cf-5041ebef5f11 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:15.797607 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58421f24-b08f-4c48-a9cf-5041ebef5f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:15.797878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58421f24-b08f-4c48-a9cf-5041ebef5f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:15.799453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-58421f24-b08f-4c48-a9cf-5041ebef5f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:15.907840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58421f24-b08f-4c48-a9cf-5041ebef5f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:15.909256 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58421f24-b08f-4c48-a9cf-5041ebef5f11 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:15.928911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 569/1147] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:25.330881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=22 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:25.926501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=66 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:36.031118 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e156-ee54-483a-91cf-30c85252ed5c None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:36.031632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e156-ee54-483a-91cf-30c85252ed5c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:36.031632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6e156-ee54-483a-91cf-30c85252ed5c None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:36.033018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 579/1148] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:36.039078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f0691-6919-4ae2-9f7c-19c847f08aea None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:36.039785 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f0691-6919-4ae2-9f7c-19c847f08aea None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:36.039901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f0691-6919-4ae2-9f7c-19c847f08aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:36.105178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7f2f0691-6919-4ae2-9f7c-19c847f08aea None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:36.106399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7f2f0691-6919-4ae2-9f7c-19c847f08aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:36.200949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 570/1149] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:36.500041 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c499b8-2831-47b0-8702-070e2ea9bf33 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:36.500341 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c499b8-2831-47b0-8702-070e2ea9bf33 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:36.500615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c499b8-2831-47b0-8702-070e2ea9bf33 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:36.502000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 580/1150] 10.222.0.45 () {54 vars in 962 bytes} [Mon Oct 31 15:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:36.508043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055b88a-487e-4626-8de2-d373ca432885 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:36.508323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055b88a-487e-4626-8de2-d373ca432885 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:36.508593 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055b88a-487e-4626-8de2-d373ca432885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:36.582420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e055b88a-487e-4626-8de2-d373ca432885 None None] MFA Rules not processed for user `74317ae6b47843de85d03f3a9d3a811d`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:36.584375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e055b88a-487e-4626-8de2-d373ca432885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:36.604279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:36.658267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 571/1151] 10.222.0.45 () {58 vars in 1059 bytes} [Mon Oct 31 15:03:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:03:36.666485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c499b8-2831-47b0-8702-070e2ea9bf33 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:36.667998 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f0c499b8-2831-47b0-8702-070e2ea9bf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:36.770108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c499b8-2831-47b0-8702-070e2ea9bf33 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:36.843562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6445c2-c741-49be-92fd-30f4c366482a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74317ae6b47843de85d03f3a9d3a811d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:36.844198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6445c2-c741-49be-92fd-30f4c366482a service glance] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:36.844482 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6445c2-c741-49be-92fd-30f4c366482a service glance] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:36.844773 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6445c2-c741-49be-92fd-30f4c366482a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:36.846395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0c6445c2-c741-49be-92fd-30f4c366482a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:36.900555 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:36.956241 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6445c2-c741-49be-92fd-30f4c366482a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:36.957718 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6445c2-c741-49be-92fd-30f4c366482a service glance] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:36.977546 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 581/1152] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:39.205813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9434935-88ae-4a6f-8eb5-c5e3880d6114 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:39.206404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9434935-88ae-4a6f-8eb5-c5e3880d6114 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:39.206404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9434935-88ae-4a6f-8eb5-c5e3880d6114 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:39.207705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 572/1153] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:39.213119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c65b7-b58d-4c54-a8a6-44864874e025 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:39.213608 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c65b7-b58d-4c54-a8a6-44864874e025 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:39.213705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c65b7-b58d-4c54-a8a6-44864874e025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:39.279711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-699c65b7-b58d-4c54-a8a6-44864874e025 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:39.280831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-699c65b7-b58d-4c54-a8a6-44864874e025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:39.376785 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 582/1154] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:39.653729 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9434935-88ae-4a6f-8eb5-c5e3880d6114 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:39.655265 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d9434935-88ae-4a6f-8eb5-c5e3880d6114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:39.784982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9434935-88ae-4a6f-8eb5-c5e3880d6114 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:39.836461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:39.882372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4041ac-705a-4476-823d-71fe732805ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:39.882497 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4041ac-705a-4476-823d-71fe732805ee admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:39.882738 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4041ac-705a-4476-823d-71fe732805ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:39.883015 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4041ac-705a-4476-823d-71fe732805ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:39.883654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4041ac-705a-4476-823d-71fe732805ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:39.884813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-7b4041ac-705a-4476-823d-71fe732805ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:03:39.884813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: warnings.warn(msg) Oct 31 15:03:39.884813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: Oct 31 15:03:39.885912 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4041ac-705a-4476-823d-71fe732805ee admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:39.908431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 573/1155] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Oct 31 15:03:39 2022] GET /identity/v3/projects => generated 2553 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:03:42.104310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bf949-b97d-4a57-a569-023c73bb89f0 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:42.104842 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bf949-b97d-4a57-a569-023c73bb89f0 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:42.104842 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bf949-b97d-4a57-a569-023c73bb89f0 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:42.106288 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 583/1156] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:42.111418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12a076-48f8-4cf9-a71e-2e176727d88e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:42.111850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12a076-48f8-4cf9-a71e-2e176727d88e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:42.111956 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12a076-48f8-4cf9-a71e-2e176727d88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:42.177372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1b12a076-48f8-4cf9-a71e-2e176727d88e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:42.178502 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1b12a076-48f8-4cf9-a71e-2e176727d88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:42.272852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 574/1157] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:42.574340 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bf949-b97d-4a57-a569-023c73bb89f0 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:42.574340 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-599bf949-b97d-4a57-a569-023c73bb89f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:42.580581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:42.717153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bf949-b97d-4a57-a569-023c73bb89f0 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:42.796972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:42.829895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3780ae-9629-4f0f-94ef-95a2cd74a58b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:42.830630 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3780ae-9629-4f0f-94ef-95a2cd74a58b service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:42.830908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3780ae-9629-4f0f-94ef-95a2cd74a58b service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:42.831177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3780ae-9629-4f0f-94ef-95a2cd74a58b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:42.833011 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-1c3780ae-9629-4f0f-94ef-95a2cd74a58b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:42.922875 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3780ae-9629-4f0f-94ef-95a2cd74a58b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:42.924438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3780ae-9629-4f0f-94ef-95a2cd74a58b service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:42.943360 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 584/1158] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:45.276757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b66b5-d193-4bb0-8479-630371096c9d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:45.277306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b66b5-d193-4bb0-8479-630371096c9d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:45.277306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b66b5-d193-4bb0-8479-630371096c9d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:45.278635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 575/1159] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:45.283752 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366bc6-16a4-4719-999c-2eccc5789ef7 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:45.284196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366bc6-16a4-4719-999c-2eccc5789ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:45.284328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366bc6-16a4-4719-999c-2eccc5789ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:45.351598 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f8366bc6-16a4-4719-999c-2eccc5789ef7 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:45.352855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f8366bc6-16a4-4719-999c-2eccc5789ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:45.400482 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:45.451109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 585/1160] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:45.741071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b66b5-d193-4bb0-8479-630371096c9d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:45.742643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-081b66b5-d193-4bb0-8479-630371096c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:45.766619 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:45.846493 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b66b5-d193-4bb0-8479-630371096c9d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:45.920731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c975caf-67de-4b2e-8531-1b9c60d7c768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:45.921368 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c975caf-67de-4b2e-8531-1b9c60d7c768 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:45.921645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c975caf-67de-4b2e-8531-1b9c60d7c768 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:45.921914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c975caf-67de-4b2e-8531-1b9c60d7c768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:45.923505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5c975caf-67de-4b2e-8531-1b9c60d7c768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:45.997408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:46.033151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c975caf-67de-4b2e-8531-1b9c60d7c768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:46.036004 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c975caf-67de-4b2e-8531-1b9c60d7c768 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:46.054148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 576/1161] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:48.251016 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f6035-6bea-4ade-91a6-ed080a2fb821 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:48.251547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f6035-6bea-4ade-91a6-ed080a2fb821 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:48.251547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f6035-6bea-4ade-91a6-ed080a2fb821 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:48.252926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 586/1162] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:48.258699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ad5b2-d7bc-4021-bbe5-41e89b544ec5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:48.259135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ad5b2-d7bc-4021-bbe5-41e89b544ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:48.259242 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ad5b2-d7bc-4021-bbe5-41e89b544ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:48.324624 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e40ad5b2-d7bc-4021-bbe5-41e89b544ec5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:48.325839 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e40ad5b2-d7bc-4021-bbe5-41e89b544ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:48.421213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 577/1163] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:48.717085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f6035-6bea-4ade-91a6-ed080a2fb821 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:48.718754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e45f6035-6bea-4ade-91a6-ed080a2fb821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:48.825199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f6035-6bea-4ade-91a6-ed080a2fb821 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:48.896543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:48.898039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da44f16-4bc5-4b48-a7ac-99cdc3f21b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:48.898636 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da44f16-4bc5-4b48-a7ac-99cdc3f21b6c service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:48.898910 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da44f16-4bc5-4b48-a7ac-99cdc3f21b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:48.899177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da44f16-4bc5-4b48-a7ac-99cdc3f21b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:48.900750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5da44f16-4bc5-4b48-a7ac-99cdc3f21b6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:49.009053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da44f16-4bc5-4b48-a7ac-99cdc3f21b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:49.010565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da44f16-4bc5-4b48-a7ac-99cdc3f21b6c service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:49.028076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 587/1164] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:51.364629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d92f60-af15-4fb1-a190-07e00076d276 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:51.365204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d92f60-af15-4fb1-a190-07e00076d276 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:51.365204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d92f60-af15-4fb1-a190-07e00076d276 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:51.366607 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 578/1165] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:51.371935 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299184ee-9997-48a2-aaf8-68a5c43e0588 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:51.372394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299184ee-9997-48a2-aaf8-68a5c43e0588 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:51.372491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299184ee-9997-48a2-aaf8-68a5c43e0588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:51.439355 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-299184ee-9997-48a2-aaf8-68a5c43e0588 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:51.440580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-299184ee-9997-48a2-aaf8-68a5c43e0588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:51.491985 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:51.535195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 588/1166] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:51.837393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d92f60-af15-4fb1-a190-07e00076d276 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:51.837393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-25d92f60-af15-4fb1-a190-07e00076d276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:51.869925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:51.936571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d92f60-af15-4fb1-a190-07e00076d276 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:52.010418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ebd12-8169-493b-9214-9dcaba7c9a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:52.011017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ebd12-8169-493b-9214-9dcaba7c9a7a service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:52.011290 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ebd12-8169-493b-9214-9dcaba7c9a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:52.011557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ebd12-8169-493b-9214-9dcaba7c9a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:52.013125 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6a8ebd12-8169-493b-9214-9dcaba7c9a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:52.092241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:52.120525 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ebd12-8169-493b-9214-9dcaba7c9a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:52.121981 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ebd12-8169-493b-9214-9dcaba7c9a7a service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:52.140863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 579/1167] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:03:54.842341 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c1737-fc82-429c-b244-ca4c818b929d None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:54.842962 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c1737-fc82-429c-b244-ca4c818b929d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:54.842962 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c1737-fc82-429c-b244-ca4c818b929d None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:54.844248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 589/1168] 10.222.0.45 () {54 vars in 927 bytes} [Mon Oct 31 15:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:03:54.850355 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1913702-058b-44e3-928d-fce3607ab459 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:54.850831 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1913702-058b-44e3-928d-fce3607ab459 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:54.850936 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1913702-058b-44e3-928d-fce3607ab459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:54.918310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c1913702-058b-44e3-928d-fce3607ab459 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:03:54.919497 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c1913702-058b-44e3-928d-fce3607ab459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:55.015832 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 580/1169] 10.222.0.45 () {58 vars in 1024 bytes} [Mon Oct 31 15:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:03:55.303249 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c1737-fc82-429c-b244-ca4c818b929d None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:03:55.304885 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-296c1737-fc82-429c-b244-ca4c818b929d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:55.410109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c1737-fc82-429c-b244-ca4c818b929d None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:03:55.484617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25422291-3a4d-4715-89c9-b023fd8dce7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:03:55.485218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25422291-3a4d-4715-89c9-b023fd8dce7b service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:03:55.485515 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25422291-3a4d-4715-89c9-b023fd8dce7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:03:55.485779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25422291-3a4d-4715-89c9-b023fd8dce7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:03:55.487366 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-25422291-3a4d-4715-89c9-b023fd8dce7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:03:55.496483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:03:55.596460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25422291-3a4d-4715-89c9-b023fd8dce7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:03:55.607793 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25422291-3a4d-4715-89c9-b023fd8dce7b service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:03:55.627067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 590/1170] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:04:05.014283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=82 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:04:05.624790 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=50 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:20.333747 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8ab51-2ba8-455f-9173-6f82d0e5004d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:20.334322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8ab51-2ba8-455f-9173-6f82d0e5004d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:20.334322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8ab51-2ba8-455f-9173-6f82d0e5004d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:20.410925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d9b8ab51-2ba8-455f-9173-6f82d0e5004d None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:20.412154 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d9b8ab51-2ba8-455f-9173-6f82d0e5004d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:20.510624 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 581/1171] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:20.519569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a48e70-5147-40a1-8864-2a9261a78966 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:20.520058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a48e70-5147-40a1-8864-2a9261a78966 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:20.520160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a48e70-5147-40a1-8864-2a9261a78966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:20.596652 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-74a48e70-5147-40a1-8864-2a9261a78966 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:20.597885 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-74a48e70-5147-40a1-8864-2a9261a78966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:20.693030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 591/1172] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:20.697817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8ab51-2ba8-455f-9173-6f82d0e5004d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:20.699061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d9b8ab51-2ba8-455f-9173-6f82d0e5004d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:20.710814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8ab51-2ba8-455f-9173-6f82d0e5004d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:20.771227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:20.804410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd930006-e3c7-4f8b-8601-e67572866c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:20.805005 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd930006-e3c7-4f8b-8601-e67572866c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:20.805280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd930006-e3c7-4f8b-8601-e67572866c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:20.805577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd930006-e3c7-4f8b-8601-e67572866c9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:20.806216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd930006-e3c7-4f8b-8601-e67572866c9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:05:20.806510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd930006-e3c7-4f8b-8601-e67572866c9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:20.807505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-dd930006-e3c7-4f8b-8601-e67572866c9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:20.807505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: warnings.warn(msg) Oct 31 15:05:20.807505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: Oct 31 15:05:20.808375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd930006-e3c7-4f8b-8601-e67572866c9b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:20.819865 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 582/1173] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:05:20.829252 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a48e70-5147-40a1-8864-2a9261a78966 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:20.839164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a48e70-5147-40a1-8864-2a9261a78966 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:20.899975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:20.933155 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2f65d-16a5-40d2-95f1-2c8c8a7a0e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:20.933780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f65d-16a5-40d2-95f1-2c8c8a7a0e35 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:20.934056 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f65d-16a5-40d2-95f1-2c8c8a7a0e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:20.934322 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f65d-16a5-40d2-95f1-2c8c8a7a0e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:20.934942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2f65d-16a5-40d2-95f1-2c8c8a7a0e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:20.936037 dv-cinder-860227-3-smb devstack@keystone.service[81684]: WARNING py.warnings [None req-48a2f65d-16a5-40d2-95f1-2c8c8a7a0e35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:20.936037 dv-cinder-860227-3-smb devstack@keystone.service[81684]: warnings.warn(msg) Oct 31 15:05:20.936037 dv-cinder-860227-3-smb devstack@keystone.service[81684]: Oct 31 15:05:20.937211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2f65d-16a5-40d2-95f1-2c8c8a7a0e35 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:21.078317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 592/1174] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:05:20 2022] POST /identity/v3/projects => generated 377 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:21.082239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd930006-e3c7-4f8b-8601-e67572866c9b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:21.083749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dd930006-e3c7-4f8b-8601-e67572866c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:21.117996 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd930006-e3c7-4f8b-8601-e67572866c9b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:21.212364 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc69c2-5c21-4a60-8dcc-db079633db11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:21.212884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc69c2-5c21-4a60-8dcc-db079633db11 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:21.213159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc69c2-5c21-4a60-8dcc-db079633db11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:21.213459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc69c2-5c21-4a60-8dcc-db079633db11 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:21.214092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc69c2-5c21-4a60-8dcc-db079633db11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:21.215090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-e8fc69c2-5c21-4a60-8dcc-db079633db11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:21.215090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: warnings.warn(msg) Oct 31 15:05:21.215090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: Oct 31 15:05:21.216279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc69c2-5c21-4a60-8dcc-db079633db11 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:21.339468 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 583/1175] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:05:21 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:05:21.343657 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2f65d-16a5-40d2-95f1-2c8c8a7a0e35 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:21.345645 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-48a2f65d-16a5-40d2-95f1-2c8c8a7a0e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:21.413604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2f65d-16a5-40d2-95f1-2c8c8a7a0e35 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:21.497060 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:21.506947 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f521590-d16b-46b2-b020-18ba5463b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:21.513419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f521590-d16b-46b2-b020-18ba5463b598 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:21.513419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f521590-d16b-46b2-b020-18ba5463b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:21.513419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f521590-d16b-46b2-b020-18ba5463b598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:21.513419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f521590-d16b-46b2-b020-18ba5463b598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:21.513419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f521590-d16b-46b2-b020-18ba5463b598 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:21.524078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 593/1176] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:21.528344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc69c2-5c21-4a60-8dcc-db079633db11 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:21.529893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e8fc69c2-5c21-4a60-8dcc-db079633db11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:21.542189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc69c2-5c21-4a60-8dcc-db079633db11 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:21.567330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:21.635189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9752aa-3576-463f-b617-e204975038e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:21.635792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9752aa-3576-463f-b617-e204975038e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:21.636067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9752aa-3576-463f-b617-e204975038e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:21.636335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9752aa-3576-463f-b617-e204975038e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:21.636968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9752aa-3576-463f-b617-e204975038e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:21.638604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9752aa-3576-463f-b617-e204975038e9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:21.650839 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 584/1177] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:05:21.655089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f521590-d16b-46b2-b020-18ba5463b598 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:21.656633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6f521590-d16b-46b2-b020-18ba5463b598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:21.690550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f521590-d16b-46b2-b020-18ba5463b598 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:21.782329 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e1d7b-24bf-47e6-8ad8-3eb54dc209dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:21.783519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e1d7b-24bf-47e6-8ad8-3eb54dc209dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:21.783784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e1d7b-24bf-47e6-8ad8-3eb54dc209dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:21.784050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e1d7b-24bf-47e6-8ad8-3eb54dc209dc admin admin] PATH_INFO: `/v3/projects/575bb47bfdbe4af2b352d51afb78f809/users/e0c286d3320e4ce9b18125753a0a8feb/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:21.806526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e1d7b-24bf-47e6-8ad8-3eb54dc209dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=575bb47bfdbe4af2b352d51afb78f809, user_id=e0c286d3320e4ce9b18125753a0a8feb, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:21.810986 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e1d7b-24bf-47e6-8ad8-3eb54dc209dc admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:21.942864 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 594/1178] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:05:21 2022] PUT /identity/v3/projects/575bb47bfdbe4af2b352d51afb78f809/users/e0c286d3320e4ce9b18125753a0a8feb/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:21.954330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a789853-7179-4401-8556-e583f7371cb9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:21.955147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a789853-7179-4401-8556-e583f7371cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:21.955467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a789853-7179-4401-8556-e583f7371cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:22.018078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5a789853-7179-4401-8556-e583f7371cb9 None None] MFA Rules not processed for user `e0c286d3320e4ce9b18125753a0a8feb`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:22.019385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5a789853-7179-4401-8556-e583f7371cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:22.098469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 585/1179] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:05:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:22.111849 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58593-6842-437f-ab49-9fca849541dc None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:22.112124 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58593-6842-437f-ab49-9fca849541dc None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:22.112534 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58593-6842-437f-ab49-9fca849541dc None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:22.113949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 595/1180] 10.222.0.45 () {54 vars in 963 bytes} [Mon Oct 31 15:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:05:22.118597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff890f-c66a-4563-86bd-963d36791602 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:22.118885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff890f-c66a-4563-86bd-963d36791602 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:22.119160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff890f-c66a-4563-86bd-963d36791602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:22.151967 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:22.195907 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-77ff890f-c66a-4563-86bd-963d36791602 None None] MFA Rules not processed for user `1277082583d64fc5a37d50f38393a51c`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:22.197111 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-77ff890f-c66a-4563-86bd-963d36791602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:22.274963 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 586/1181] 10.222.0.45 () {58 vars in 1060 bytes} [Mon Oct 31 15:05:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:05:22.282970 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa58593-6842-437f-ab49-9fca849541dc None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:22.284481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5aa58593-6842-437f-ab49-9fca849541dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:22.335462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:22.388184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa58593-6842-437f-ab49-9fca849541dc None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:22.461168 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49990bfb-ccf6-421e-82cc-7e6ee13ac015 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:22.461793 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49990bfb-ccf6-421e-82cc-7e6ee13ac015 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:22.462064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49990bfb-ccf6-421e-82cc-7e6ee13ac015 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:22.462327 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49990bfb-ccf6-421e-82cc-7e6ee13ac015 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:22.463894 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-49990bfb-ccf6-421e-82cc-7e6ee13ac015 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:22.561446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49990bfb-ccf6-421e-82cc-7e6ee13ac015 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:22.562852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49990bfb-ccf6-421e-82cc-7e6ee13ac015 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:22.566422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:22.581207 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 596/1182] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:05:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:05:22.626213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba231c-37f8-4f06-b3c0-ee896cf4f3f1 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:22.626982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba231c-37f8-4f06-b3c0-ee896cf4f3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:22.627272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba231c-37f8-4f06-b3c0-ee896cf4f3f1 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:22.628551 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 587/1183] 10.222.0.45 () {52 vars in 830 bytes} [Mon Oct 31 15:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:05:22.632188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49990bfb-ccf6-421e-82cc-7e6ee13ac015 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:22.633500 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-49990bfb-ccf6-421e-82cc-7e6ee13ac015 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:22.734409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49990bfb-ccf6-421e-82cc-7e6ee13ac015 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:22.830647 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:22.831275 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:22.831553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:22.831824 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] PATH_INFO: `/v3/users/e0c286d3320e4ce9b18125753a0a8feb` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:22.844552 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c286d3320e4ce9b18125753a0a8feb)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:22.858295 dv-cinder-860227-3-smb devstack@keystone.service[81684]: WARNING py.warnings [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:22.858295 dv-cinder-860227-3-smb devstack@keystone.service[81684]: warnings.warn(msg) Oct 31 15:05:22.858295 dv-cinder-860227-3-smb devstack@keystone.service[81684]: Oct 31 15:05:22.858295 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:22.858295 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:23.095014 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c286d3320e4ce9b18125753a0a8feb'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:23.095638 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c286d3320e4ce9b18125753a0a8feb'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:23.118305 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c286d3320e4ce9b18125753a0a8feb'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:23.118855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c286d3320e4ce9b18125753a0a8feb'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:23.264542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c286d3320e4ce9b18125753a0a8feb'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:23.284619 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 597/1184] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:05:22 2022] DELETE /identity/v3/users/e0c286d3320e4ce9b18125753a0a8feb => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:23.289030 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d4d9b-94cc-48a5-8608-bafa88293c27 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:23.289342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d4d9b-94cc-48a5-8608-bafa88293c27 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:23.289619 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d4d9b-94cc-48a5-8608-bafa88293c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:23.346831 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-111d4d9b-94cc-48a5-8608-bafa88293c27 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:05:23.347953 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-111d4d9b-94cc-48a5-8608-bafa88293c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:23.422362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:23.434922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 588/1185] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:05:23.450987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:23.450987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:23.550932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d86ba-fceb-43b8-9716-078338e1e1b0 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:23.607768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:23.627276 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceeb189-25aa-410c-8ca7-830deeec50dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:23.639691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeb189-25aa-410c-8ca7-830deeec50dd service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:23.639691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeb189-25aa-410c-8ca7-830deeec50dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:23.639691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeb189-25aa-410c-8ca7-830deeec50dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:23.639691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7ceeb189-25aa-410c-8ca7-830deeec50dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:23.738602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceeb189-25aa-410c-8ca7-830deeec50dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:23.740022 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceeb189-25aa-410c-8ca7-830deeec50dd service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:23.761467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 598/1186] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:05:24.293019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d4d9b-94cc-48a5-8608-bafa88293c27 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:05:24.294376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-111d4d9b-94cc-48a5-8608-bafa88293c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:05:24.306070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d4d9b-94cc-48a5-8608-bafa88293c27 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:05:24.405934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095e9c6-3cfa-46b2-a595-b5c2890717da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:05:24.406598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095e9c6-3cfa-46b2-a595-b5c2890717da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:05:24.406865 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095e9c6-3cfa-46b2-a595-b5c2890717da admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:05:24.407140 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095e9c6-3cfa-46b2-a595-b5c2890717da admin admin] PATH_INFO: `/v3/projects/575bb47bfdbe4af2b352d51afb78f809` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:05:24.417419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095e9c6-3cfa-46b2-a595-b5c2890717da admin admin] RBAC: Authorizing `identity:delete_project(project_id=575bb47bfdbe4af2b352d51afb78f809)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:05:24.418433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-e095e9c6-3cfa-46b2-a595-b5c2890717da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:05:24.418433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: warnings.warn(msg) Oct 31 15:05:24.418433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: Oct 31 15:05:24.419616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095e9c6-3cfa-46b2-a595-b5c2890717da admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:05:24.547141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e095e9c6-3cfa-46b2-a595-b5c2890717da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575bb47bfdbe4af2b352d51afb78f809', 'request_id': 'req-e095e9c6-3cfa-46b2-a595-b5c2890717da'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:24.627993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e095e9c6-3cfa-46b2-a595-b5c2890717da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575bb47bfdbe4af2b352d51afb78f809', 'request_id': 'req-e095e9c6-3cfa-46b2-a595-b5c2890717da'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:24.641587 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e095e9c6-3cfa-46b2-a595-b5c2890717da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575bb47bfdbe4af2b352d51afb78f809', 'request_id': 'req-e095e9c6-3cfa-46b2-a595-b5c2890717da'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:24.664868 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e095e9c6-3cfa-46b2-a595-b5c2890717da admin admin] The token cache is being invalidate because project 575bb47bfdbe4af2b352d51afb78f809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:05:24.665152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e095e9c6-3cfa-46b2-a595-b5c2890717da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:24.665608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e095e9c6-3cfa-46b2-a595-b5c2890717da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:05:24.667268 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 589/1187] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:05:24 2022] DELETE /identity/v3/projects/575bb47bfdbe4af2b352d51afb78f809 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:05:33.759191 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=62 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:05:34.662858 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:03.367199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d43c3-d21b-4e81-a8c9-0b58ecf1aa28 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:03.367788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d43c3-d21b-4e81-a8c9-0b58ecf1aa28 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:03.367788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d43c3-d21b-4e81-a8c9-0b58ecf1aa28 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:03.369073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 599/1188] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 15:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:07:03.374033 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e20f6-f6b5-48ba-a157-897b552252e1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:03.374436 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e20f6-f6b5-48ba-a157-897b552252e1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:03.374576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e20f6-f6b5-48ba-a157-897b552252e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:03.456801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-316e20f6-f6b5-48ba-a157-897b552252e1 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:03.458017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-316e20f6-f6b5-48ba-a157-897b552252e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:03.561413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 590/1189] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 15:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:03.718304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d43c3-d21b-4e81-a8c9-0b58ecf1aa28 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:03.731992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-531d43c3-d21b-4e81-a8c9-0b58ecf1aa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:03.839356 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d43c3-d21b-4e81-a8c9-0b58ecf1aa28 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:03.844851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b43724-2974-4a84-b5db-6ac152ce7781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:03.845473 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b43724-2974-4a84-b5db-6ac152ce7781 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:03.845752 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b43724-2974-4a84-b5db-6ac152ce7781 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:03.846022 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b43724-2974-4a84-b5db-6ac152ce7781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:03.855098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b43724-2974-4a84-b5db-6ac152ce7781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:03.856673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b43724-2974-4a84-b5db-6ac152ce7781 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:03.866027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 600/1190] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:04.814515 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221529c7-d860-4c67-bb3e-af822260edc6 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:04.815066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221529c7-d860-4c67-bb3e-af822260edc6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:04.815066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221529c7-d860-4c67-bb3e-af822260edc6 None None] PATH_INFO: `/v3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:04.816477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 591/1191] 10.222.0.23 () {54 vars in 925 bytes} [Mon Oct 31 15:07:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:07:04.822788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd337d-d70d-40e4-92b6-70a241a9d578 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:04.823220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd337d-d70d-40e4-92b6-70a241a9d578 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:04.823321 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd337d-d70d-40e4-92b6-70a241a9d578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:04.885621 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0ffd337d-d70d-40e4-92b6-70a241a9d578 None None] MFA Rules not processed for user `77b43d235d0441b3b8a272d051b54ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:04.886860 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0ffd337d-d70d-40e4-92b6-70a241a9d578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:04.949669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88778f-30c4-4006-b2fb-7da21e514ea0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:04.949946 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88778f-30c4-4006-b2fb-7da21e514ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:04.950215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88778f-30c4-4006-b2fb-7da21e514ea0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:04.951582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 592/1192] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 15:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 15:07:04.955858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:04.957139 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f41ac-40b5-4557-9efe-4cd13c1d11e0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:04.957530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f41ac-40b5-4557-9efe-4cd13c1d11e0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:04.957817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f41ac-40b5-4557-9efe-4cd13c1d11e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:04.961260 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 601/1193] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Oct 31 15:07:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:04.978920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f80f41ac-40b5-4557-9efe-4cd13c1d11e0 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:04.980130 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f80f41ac-40b5-4557-9efe-4cd13c1d11e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:04.988845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 593/1194] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 15:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:05.141030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd337d-d70d-40e4-92b6-70a241a9d578 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:05.153531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd337d-d70d-40e4-92b6-70a241a9d578 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:05.158931 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6508402-c023-40c0-8b86-d16fdb6fb55a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:05.159587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508402-c023-40c0-8b86-d16fdb6fb55a service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:05.160472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508402-c023-40c0-8b86-d16fdb6fb55a service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:05.160742 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508402-c023-40c0-8b86-d16fdb6fb55a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:05.168562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6508402-c023-40c0-8b86-d16fdb6fb55a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:05.170161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6508402-c023-40c0-8b86-d16fdb6fb55a service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:05.179693 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 602/1195] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:08.816123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56c24c-1acf-422f-9303-287beaae7554 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:08.816567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56c24c-1acf-422f-9303-287beaae7554 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:08.816839 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56c24c-1acf-422f-9303-287beaae7554 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:08.818219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 594/1196] 10.222.0.45 () {54 vars in 961 bytes} [Mon Oct 31 15:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:07:08.823227 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49067535-2419-4f78-bfbc-65b8df71859d None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:08.823677 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49067535-2419-4f78-bfbc-65b8df71859d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:08.823783 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49067535-2419-4f78-bfbc-65b8df71859d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:08.843993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-49067535-2419-4f78-bfbc-65b8df71859d None None] MFA Rules not processed for user `77b43d235d0441b3b8a272d051b54ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:08.845181 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-49067535-2419-4f78-bfbc-65b8df71859d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:08.854309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 603/1197] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Oct 31 15:07:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:08.861952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56c24c-1acf-422f-9303-287beaae7554 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:08.874850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56c24c-1acf-422f-9303-287beaae7554 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:08.879678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9dda2-390e-4238-adf0-509fbcaef995 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:08.880254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9dda2-390e-4238-adf0-509fbcaef995 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:08.880526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9dda2-390e-4238-adf0-509fbcaef995 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:08.880790 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9dda2-390e-4238-adf0-509fbcaef995 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:08.888767 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9dda2-390e-4238-adf0-509fbcaef995 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:08.890350 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9dda2-390e-4238-adf0-509fbcaef995 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:08.900392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 595/1198] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:16.667609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5cea9-1c5b-4e55-8417-e89d7fef7b6b None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:16.668159 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5cea9-1c5b-4e55-8417-e89d7fef7b6b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:16.668159 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5cea9-1c5b-4e55-8417-e89d7fef7b6b None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:16.669531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 604/1199] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 15:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:07:16.674479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116702d3-ccea-41c2-9e42-46785bdf0b09 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:16.674887 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116702d3-ccea-41c2-9e42-46785bdf0b09 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:16.675063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116702d3-ccea-41c2-9e42-46785bdf0b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:16.694828 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-116702d3-ccea-41c2-9e42-46785bdf0b09 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:16.696024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-116702d3-ccea-41c2-9e42-46785bdf0b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:16.703751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 596/1200] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 15:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:16.859863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5cea9-1c5b-4e55-8417-e89d7fef7b6b None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:16.873891 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5cea9-1c5b-4e55-8417-e89d7fef7b6b None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:16.880217 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9696337-9efd-4847-91bd-700a6c3eb070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:16.880958 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696337-9efd-4847-91bd-700a6c3eb070 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:16.881345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696337-9efd-4847-91bd-700a6c3eb070 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:16.881700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696337-9efd-4847-91bd-700a6c3eb070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:16.890579 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9696337-9efd-4847-91bd-700a6c3eb070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:16.892137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9696337-9efd-4847-91bd-700a6c3eb070 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:16.902884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 605/1201] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:17.966198 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c45170-70d5-4b68-a222-227ab3633670 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:17.966745 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c45170-70d5-4b68-a222-227ab3633670 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:17.966745 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c45170-70d5-4b68-a222-227ab3633670 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:17.968134 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 597/1202] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 31 15:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:07:17.973202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eec5b-42cf-48c0-a8ab-add33b2c230e None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:17.973695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eec5b-42cf-48c0-a8ab-add33b2c230e None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:17.973801 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eec5b-42cf-48c0-a8ab-add33b2c230e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:17.993597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-fb0eec5b-42cf-48c0-a8ab-add33b2c230e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:17.994791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-fb0eec5b-42cf-48c0-a8ab-add33b2c230e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:18.002577 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 606/1203] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 31 15:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:18.155655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c45170-70d5-4b68-a222-227ab3633670 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:18.170542 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c45170-70d5-4b68-a222-227ab3633670 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:18.176827 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77710c-f833-41d6-8078-a2243b014d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:18.177445 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77710c-f833-41d6-8078-a2243b014d39 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:18.177722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77710c-f833-41d6-8078-a2243b014d39 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:18.177987 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77710c-f833-41d6-8078-a2243b014d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:18.185864 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77710c-f833-41d6-8078-a2243b014d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:18.187429 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77710c-f833-41d6-8078-a2243b014d39 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:18.196747 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 598/1204] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:22.300771 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8b426-88d2-46d2-8928-4da30c6fa565 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:22.301343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8b426-88d2-46d2-8928-4da30c6fa565 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:22.301343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8b426-88d2-46d2-8928-4da30c6fa565 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:22.302597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 607/1205] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:07:22.307718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f4c48-9a7f-4b70-8b15-215e9234b3ac None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:22.308163 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f4c48-9a7f-4b70-8b15-215e9234b3ac None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:22.308260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f4c48-9a7f-4b70-8b15-215e9234b3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:22.328507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-829f4c48-9a7f-4b70-8b15-215e9234b3ac None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:22.329739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-829f4c48-9a7f-4b70-8b15-215e9234b3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:22.337648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 599/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:22.627700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8b426-88d2-46d2-8928-4da30c6fa565 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:22.630079 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3bc8b426-88d2-46d2-8928-4da30c6fa565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:22.708912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8b426-88d2-46d2-8928-4da30c6fa565 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:22.712444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921f81b-4f6c-4b98-a36d-4a3d5913a203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:22.713043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921f81b-4f6c-4b98-a36d-4a3d5913a203 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:22.713336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921f81b-4f6c-4b98-a36d-4a3d5913a203 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:22.713606 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921f81b-4f6c-4b98-a36d-4a3d5913a203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:22.723331 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921f81b-4f6c-4b98-a36d-4a3d5913a203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:22.724753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921f81b-4f6c-4b98-a36d-4a3d5913a203 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:22.734064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 608/1207] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:24.882863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e135b-8eab-42ff-a9fe-5425bbdae89a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:24.883454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e135b-8eab-42ff-a9fe-5425bbdae89a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:24.883454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e135b-8eab-42ff-a9fe-5425bbdae89a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:24.884789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 600/1208] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:07:24.889870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace16a1b-4d84-425a-9bde-f91d1171b35e None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:24.890326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace16a1b-4d84-425a-9bde-f91d1171b35e None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:24.890429 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace16a1b-4d84-425a-9bde-f91d1171b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:24.910857 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-ace16a1b-4d84-425a-9bde-f91d1171b35e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:24.912043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ace16a1b-4d84-425a-9bde-f91d1171b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:24.919804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 609/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:25.205267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e135b-8eab-42ff-a9fe-5425bbdae89a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:25.207647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-049e135b-8eab-42ff-a9fe-5425bbdae89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:25.215214 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:25.220545 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e135b-8eab-42ff-a9fe-5425bbdae89a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:25.224417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c6889-fff3-463f-a6c3-bebf8aa0dd4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:25.232028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c6889-fff3-463f-a6c3-bebf8aa0dd4f service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:25.232028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c6889-fff3-463f-a6c3-bebf8aa0dd4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:25.232028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c6889-fff3-463f-a6c3-bebf8aa0dd4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:25.234493 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c6889-fff3-463f-a6c3-bebf8aa0dd4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:25.236006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c6889-fff3-463f-a6c3-bebf8aa0dd4f service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:25.246246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 601/1210] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:28.989669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f6ce-161d-4326-ab7e-c6ae94206b1f None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:28.990156 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f6ce-161d-4326-ab7e-c6ae94206b1f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:28.990250 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604f6ce-161d-4326-ab7e-c6ae94206b1f None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:28.991544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 610/1211] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:07:28.996960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dd336-1724-48fa-9388-339e722dab42 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:28.997414 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dd336-1724-48fa-9388-339e722dab42 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:29.003847 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43dd336-1724-48fa-9388-339e722dab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:29.017230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e43dd336-1724-48fa-9388-339e722dab42 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:29.018574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e43dd336-1724-48fa-9388-339e722dab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:29.026727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 602/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:07:29.332368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604f6ce-161d-4326-ab7e-c6ae94206b1f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:29.334102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-1604f6ce-161d-4326-ab7e-c6ae94206b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:29.413743 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604f6ce-161d-4326-ab7e-c6ae94206b1f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:29.417279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478102b-b006-4f77-a41b-67749aebd9cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:29.417902 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478102b-b006-4f77-a41b-67749aebd9cd service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:29.418172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478102b-b006-4f77-a41b-67749aebd9cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:29.418434 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478102b-b006-4f77-a41b-67749aebd9cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:29.427799 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478102b-b006-4f77-a41b-67749aebd9cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:29.429214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478102b-b006-4f77-a41b-67749aebd9cd service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:29.438449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 611/1213] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:31.590373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc98032-b668-4c03-b56c-1ae85353fde2 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:31.590979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc98032-b668-4c03-b56c-1ae85353fde2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:31.590979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc98032-b668-4c03-b56c-1ae85353fde2 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:31.592254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 603/1214] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 31 15:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:07:31.598222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d636222-6e93-4da9-8e1d-4885d69280a2 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:31.598624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d636222-6e93-4da9-8e1d-4885d69280a2 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:31.598734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d636222-6e93-4da9-8e1d-4885d69280a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:31.617967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-3d636222-6e93-4da9-8e1d-4885d69280a2 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:07:31.619151 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3d636222-6e93-4da9-8e1d-4885d69280a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:31.626862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 612/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 31 15:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:07:31.931259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc98032-b668-4c03-b56c-1ae85353fde2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:07:31.932944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1bc98032-b668-4c03-b56c-1ae85353fde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:07:31.946154 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc98032-b668-4c03-b56c-1ae85353fde2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:07:31.949694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dcc13-344a-40c0-9ccc-e74f4f4b4d90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:07:31.950280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dcc13-344a-40c0-9ccc-e74f4f4b4d90 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:07:31.950554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dcc13-344a-40c0-9ccc-e74f4f4b4d90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:07:31.950821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dcc13-344a-40c0-9ccc-e74f4f4b4d90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:07:31.959692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dcc13-344a-40c0-9ccc-e74f4f4b4d90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:07:31.961099 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dcc13-344a-40c0-9ccc-e74f4f4b4d90 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:07:31.970267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 604/1216] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:07:41.613743 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=95 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:41.966262 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=14 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:04.693770 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72faaa2-5a1e-4d20-aea7-34ed79e13d9c None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:04.694418 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72faaa2-5a1e-4d20-aea7-34ed79e13d9c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:04.694418 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72faaa2-5a1e-4d20-aea7-34ed79e13d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:04.723594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-b72faaa2-5a1e-4d20-aea7-34ed79e13d9c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:04.724884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b72faaa2-5a1e-4d20-aea7-34ed79e13d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:04.738740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 613/1217] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:04.754978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2220f0-27e5-45e7-bac7-e2167ac9c7f5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:04.756037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2220f0-27e5-45e7-bac7-e2167ac9c7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:04.756549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2220f0-27e5-45e7-bac7-e2167ac9c7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:04.787155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7f2220f0-27e5-45e7-bac7-e2167ac9c7f5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:04.788901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7f2220f0-27e5-45e7-bac7-e2167ac9c7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:04.804182 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 605/1218] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:04.808631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72faaa2-5a1e-4d20-aea7-34ed79e13d9c None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:04.823485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72faaa2-5a1e-4d20-aea7-34ed79e13d9c None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:04.834938 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf2f6b-a7c5-4739-82d7-470e845a7cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:04.835569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf2f6b-a7c5-4739-82d7-470e845a7cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:04.835847 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf2f6b-a7c5-4739-82d7-470e845a7cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:04.836112 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf2f6b-a7c5-4739-82d7-470e845a7cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:04.836772 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf2f6b-a7c5-4739-82d7-470e845a7cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:04.837073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf2f6b-a7c5-4739-82d7-470e845a7cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:04.838214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: WARNING py.warnings [None req-09bf2f6b-a7c5-4739-82d7-470e845a7cbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:09:04.838214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: warnings.warn(msg) Oct 31 15:09:04.838214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: Oct 31 15:09:04.839192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf2f6b-a7c5-4739-82d7-470e845a7cbb admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:04.859299 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 614/1219] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:04.868161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2220f0-27e5-45e7-bac7-e2167ac9c7f5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:04.883889 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2220f0-27e5-45e7-bac7-e2167ac9c7f5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:04.899339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babae082-eea3-4c09-be39-5eab8bd221af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:04.900569 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babae082-eea3-4c09-be39-5eab8bd221af admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:04.901136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babae082-eea3-4c09-be39-5eab8bd221af admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:04.901653 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babae082-eea3-4c09-be39-5eab8bd221af admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:04.902580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babae082-eea3-4c09-be39-5eab8bd221af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:04.903837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-babae082-eea3-4c09-be39-5eab8bd221af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:09:04.903837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: warnings.warn(msg) Oct 31 15:09:04.903837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: Oct 31 15:09:04.905507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babae082-eea3-4c09-be39-5eab8bd221af admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:05.047046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 606/1220] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:04 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:05.052123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babae082-eea3-4c09-be39-5eab8bd221af admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:05.052707 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f74fd-e75b-4d16-a18f-a1c1a52ef8a7 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.053029 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f74fd-e75b-4d16-a18f-a1c1a52ef8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.053278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f74fd-e75b-4d16-a18f-a1c1a52ef8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.087036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-c16f74fd-e75b-4d16-a18f-a1c1a52ef8a7 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.093106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c16f74fd-e75b-4d16-a18f-a1c1a52ef8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.205742 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babae082-eea3-4c09-be39-5eab8bd221af admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:05.206845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 615/1221] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.209315 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2d96c-ebde-4bf8-9d07-4edc9ed63781 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.209315 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2d96c-ebde-4bf8-9d07-4edc9ed63781 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.209315 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2d96c-ebde-4bf8-9d07-4edc9ed63781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.221608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57980496-713c-4f91-95d6-296aebfe0f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:05.221608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57980496-713c-4f91-95d6-296aebfe0f4f admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.221608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57980496-713c-4f91-95d6-296aebfe0f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.221608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57980496-713c-4f91-95d6-296aebfe0f4f admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.221952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57980496-713c-4f91-95d6-296aebfe0f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:05.223472 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57980496-713c-4f91-95d6-296aebfe0f4f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:05.241400 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-2ed2d96c-ebde-4bf8-9d07-4edc9ed63781 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.241400 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2ed2d96c-ebde-4bf8-9d07-4edc9ed63781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.258723 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 616/1222] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.260116 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020162c-75b0-4e5c-9e84-6c6564640675 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.260403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020162c-75b0-4e5c-9e84-6c6564640675 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.260677 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020162c-75b0-4e5c-9e84-6c6564640675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.287334 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-6020162c-75b0-4e5c-9e84-6c6564640675 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.288550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6020162c-75b0-4e5c-9e84-6c6564640675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.307948 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 617/1223] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.309805 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426a2e7-1a64-4c87-bbe8-642528b3fa10 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.310093 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426a2e7-1a64-4c87-bbe8-642528b3fa10 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.310362 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426a2e7-1a64-4c87-bbe8-642528b3fa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.356716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-a426a2e7-1a64-4c87-bbe8-642528b3fa10 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.358027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a426a2e7-1a64-4c87-bbe8-642528b3fa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.361907 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 607/1224] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/users => generated 284 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:05.369335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6ba30-faa6-425d-92e3-3968cfc775a5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.369335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6ba30-faa6-425d-92e3-3968cfc775a5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.369662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6ba30-faa6-425d-92e3-3968cfc775a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.375935 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 618/1225] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.377484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426a2e7-1a64-4c87-bbe8-642528b3fa10 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:05.409235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426a2e7-1a64-4c87-bbe8-642528b3fa10 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:05.411439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9db6ba30-faa6-425d-92e3-3968cfc775a5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.412728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9db6ba30-faa6-425d-92e3-3968cfc775a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.414346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edd13a-613f-4e6f-88ee-0cf90616206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:05.415001 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edd13a-613f-4e6f-88ee-0cf90616206f admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.415343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edd13a-613f-4e6f-88ee-0cf90616206f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.415623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edd13a-613f-4e6f-88ee-0cf90616206f admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.416269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edd13a-613f-4e6f-88ee-0cf90616206f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:05.416571 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edd13a-613f-4e6f-88ee-0cf90616206f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:05.418194 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edd13a-613f-4e6f-88ee-0cf90616206f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:05.422246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 608/1226] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.423639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6ba30-faa6-425d-92e3-3968cfc775a5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:05.435726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6ba30-faa6-425d-92e3-3968cfc775a5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:05.436298 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 619/1227] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:05.437684 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd3adc-154b-4331-be87-0d6e47157edf None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.437967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd3adc-154b-4331-be87-0d6e47157edf None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.438310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd3adc-154b-4331-be87-0d6e47157edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.444599 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828025e-be0b-4403-821d-9b379c47c8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:05.445213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828025e-be0b-4403-821d-9b379c47c8ab admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.445517 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828025e-be0b-4403-821d-9b379c47c8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.445789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828025e-be0b-4403-821d-9b379c47c8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.446464 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828025e-be0b-4403-821d-9b379c47c8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:05.448097 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828025e-be0b-4403-821d-9b379c47c8ab admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:05.457868 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-5dfd3adc-154b-4331-be87-0d6e47157edf None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.458951 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 609/1228] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:05.459357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5dfd3adc-154b-4331-be87-0d6e47157edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.460370 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7b3c7-d8fd-42e3-995b-49ce183170b9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.460659 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7b3c7-d8fd-42e3-995b-49ce183170b9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.460935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7b3c7-d8fd-42e3-995b-49ce183170b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.467046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 620/1229] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.469329 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f104d2-3114-4bf3-a3ce-96f5c14cdc19 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.469329 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f104d2-3114-4bf3-a3ce-96f5c14cdc19 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.469329 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f104d2-3114-4bf3-a3ce-96f5c14cdc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.482685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-79b7b3c7-d8fd-42e3-995b-49ce183170b9 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.483905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-79b7b3c7-d8fd-42e3-995b-49ce183170b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.489407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-99f104d2-3114-4bf3-a3ce-96f5c14cdc19 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.490779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-99f104d2-3114-4bf3-a3ce-96f5c14cdc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.492669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 610/1230] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.494985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddf204-530a-4aff-b41a-cc832e21f458 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.494985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddf204-530a-4aff-b41a-cc832e21f458 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.495209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddf204-530a-4aff-b41a-cc832e21f458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.504215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 621/1231] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.512078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f104d2-3114-4bf3-a3ce-96f5c14cdc19 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:05.517958 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f104d2-3114-4bf3-a3ce-96f5c14cdc19 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:05.518129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-26ddf204-530a-4aff-b41a-cc832e21f458 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.519420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-26ddf204-530a-4aff-b41a-cc832e21f458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.522861 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188dacd-4606-434d-b59a-840bec3f4398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:05.523464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188dacd-4606-434d-b59a-840bec3f4398 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.523739 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188dacd-4606-434d-b59a-840bec3f4398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.524006 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188dacd-4606-434d-b59a-840bec3f4398 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.524648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188dacd-4606-434d-b59a-840bec3f4398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:05.524944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188dacd-4606-434d-b59a-840bec3f4398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:05.526567 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188dacd-4606-434d-b59a-840bec3f4398 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:05.527783 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 611/1232] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.530067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501c4d5-e409-4366-9f96-900431185004 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.530351 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501c4d5-e409-4366-9f96-900431185004 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.530626 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501c4d5-e409-4366-9f96-900431185004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.541338 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 622/1233] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:05.541338 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188dacd-4606-434d-b59a-840bec3f4398 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:05.553473 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188dacd-4606-434d-b59a-840bec3f4398 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:05.554736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7501c4d5-e409-4366-9f96-900431185004 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.555935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7501c4d5-e409-4366-9f96-900431185004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.558076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54499d75-a7ef-456e-8719-3521a222a865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:05.558672 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54499d75-a7ef-456e-8719-3521a222a865 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.558948 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54499d75-a7ef-456e-8719-3521a222a865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.559213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54499d75-a7ef-456e-8719-3521a222a865 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.559832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54499d75-a7ef-456e-8719-3521a222a865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:05.561748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54499d75-a7ef-456e-8719-3521a222a865 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:05.564357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 612/1234] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.565136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501c4d5-e409-4366-9f96-900431185004 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:05.577813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501c4d5-e409-4366-9f96-900431185004 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:05.582993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799a132-8fcd-4f48-a7a3-a6b9f1380407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:05.583589 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799a132-8fcd-4f48-a7a3-a6b9f1380407 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.583873 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799a132-8fcd-4f48-a7a3-a6b9f1380407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.584146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799a132-8fcd-4f48-a7a3-a6b9f1380407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.584783 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799a132-8fcd-4f48-a7a3-a6b9f1380407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:05.586393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799a132-8fcd-4f48-a7a3-a6b9f1380407 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:05.596683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 613/1235] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:05.598034 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4cfb-87de-40a6-892f-f6a20a96a4f4 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.598314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4cfb-87de-40a6-892f-f6a20a96a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.598583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4cfb-87de-40a6-892f-f6a20a96a4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.616950 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-997d4cfb-87de-40a6-892f-f6a20a96a4f4 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.618172 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-997d4cfb-87de-40a6-892f-f6a20a96a4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.626503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 614/1236] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.627227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4cfb-87de-40a6-892f-f6a20a96a4f4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:05.636169 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4cfb-87de-40a6-892f-f6a20a96a4f4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:05.640804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe00248-c8a9-4ccc-af84-a159fcb88224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:05.642052 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00248-c8a9-4ccc-af84-a159fcb88224 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.642328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00248-c8a9-4ccc-af84-a159fcb88224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.642598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00248-c8a9-4ccc-af84-a159fcb88224 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.643210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe00248-c8a9-4ccc-af84-a159fcb88224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:05.643505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe00248-c8a9-4ccc-af84-a159fcb88224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:05.645110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe00248-c8a9-4ccc-af84-a159fcb88224 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:05.656572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 615/1237] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:05.657785 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44279301-0e5d-4f65-9647-f72e2178c84b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.658063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44279301-0e5d-4f65-9647-f72e2178c84b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.658335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44279301-0e5d-4f65-9647-f72e2178c84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.667132 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 623/1238] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:05.667132 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034da7aa-8d36-452e-b1c3-eeb7e77e8d51 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.667132 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034da7aa-8d36-452e-b1c3-eeb7e77e8d51 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.667132 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034da7aa-8d36-452e-b1c3-eeb7e77e8d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.679944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-44279301-0e5d-4f65-9647-f72e2178c84b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.681137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-44279301-0e5d-4f65-9647-f72e2178c84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.686380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-034da7aa-8d36-452e-b1c3-eeb7e77e8d51 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.687531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-034da7aa-8d36-452e-b1c3-eeb7e77e8d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.724569 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:05.741440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:05.749228 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 616/1239] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.749942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44279301-0e5d-4f65-9647-f72e2178c84b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:05.750084 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 624/1240] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.752015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70112-70a7-4fe1-8a0f-36a82f4bba6a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.752394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70112-70a7-4fe1-8a0f-36a82f4bba6a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.752988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70112-70a7-4fe1-8a0f-36a82f4bba6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.768309 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44279301-0e5d-4f65-9647-f72e2178c84b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:05.774512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-46e70112-70a7-4fe1-8a0f-36a82f4bba6a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:05.781259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8d2ec-9075-414c-997e-19afc6ac7887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:05.781259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8d2ec-9075-414c-997e-19afc6ac7887 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.781259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8d2ec-9075-414c-997e-19afc6ac7887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.781605 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-46e70112-70a7-4fe1-8a0f-36a82f4bba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:05.781706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8d2ec-9075-414c-997e-19afc6ac7887 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.781706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8d2ec-9075-414c-997e-19afc6ac7887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:05.781706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8d2ec-9075-414c-997e-19afc6ac7887 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:05.783946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 625/1241] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:05.784780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70112-70a7-4fe1-8a0f-36a82f4bba6a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:05.794320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70112-70a7-4fe1-8a0f-36a82f4bba6a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:05.799742 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f128c0-cc96-499f-abd4-0c03b6b31d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:05.800384 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f128c0-cc96-499f-abd4-0c03b6b31d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.800657 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f128c0-cc96-499f-abd4-0c03b6b31d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.801263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f128c0-cc96-499f-abd4-0c03b6b31d78 admin admin] PATH_INFO: `/v3/projects/c11663c959be422f86b356402a5cb9bc/users/62088e8d368349bfab1b603df1aed98c/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.816527 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f128c0-cc96-499f-abd4-0c03b6b31d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11663c959be422f86b356402a5cb9bc, user_id=62088e8d368349bfab1b603df1aed98c, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:05.819176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f128c0-cc96-499f-abd4-0c03b6b31d78 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:05.881271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 617/1242] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:05.882035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8d2ec-9075-414c-997e-19afc6ac7887 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:05.908719 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 626/1243] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:05 2022] PUT /identity/v3/projects/c11663c959be422f86b356402a5cb9bc/users/62088e8d368349bfab1b603df1aed98c/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:05.913086 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f128c0-cc96-499f-abd4-0c03b6b31d78 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:05.954219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8d2ec-9075-414c-997e-19afc6ac7887 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:05.970942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f128c0-cc96-499f-abd4-0c03b6b31d78 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:05.975645 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef609494-557a-4334-8e4b-6512cbcb7c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:05.976258 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef609494-557a-4334-8e4b-6512cbcb7c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:05.976535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef609494-557a-4334-8e4b-6512cbcb7c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:05.976801 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef609494-557a-4334-8e4b-6512cbcb7c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:05.977463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef609494-557a-4334-8e4b-6512cbcb7c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:05.979446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef609494-557a-4334-8e4b-6512cbcb7c0f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.013205 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659905b-4dda-44b0-a71c-2b584f6831c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.013768 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659905b-4dda-44b0-a71c-2b584f6831c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.014041 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659905b-4dda-44b0-a71c-2b584f6831c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.014305 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659905b-4dda-44b0-a71c-2b584f6831c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.015695 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659905b-4dda-44b0-a71c-2b584f6831c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:06.016002 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659905b-4dda-44b0-a71c-2b584f6831c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.017865 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659905b-4dda-44b0-a71c-2b584f6831c8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.036840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 618/1244] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:06.036840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659905b-4dda-44b0-a71c-2b584f6831c8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.042213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659905b-4dda-44b0-a71c-2b584f6831c8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.046916 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92023f9-e23a-476a-9eb9-429fcfa8ebc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.047505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92023f9-e23a-476a-9eb9-429fcfa8ebc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.048505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92023f9-e23a-476a-9eb9-429fcfa8ebc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.048727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92023f9-e23a-476a-9eb9-429fcfa8ebc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.049396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92023f9-e23a-476a-9eb9-429fcfa8ebc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.051541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92023f9-e23a-476a-9eb9-429fcfa8ebc3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.109786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 627/1245] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:05 2022] POST /identity/v3/projects => generated 393 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:06.111478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef609494-557a-4334-8e4b-6512cbcb7c0f admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.174304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef609494-557a-4334-8e4b-6512cbcb7c0f admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.179312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe291a4-677c-4031-8414-9b701631a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.179909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe291a4-677c-4031-8414-9b701631a8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.180184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe291a4-677c-4031-8414-9b701631a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.180526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe291a4-677c-4031-8414-9b701631a8fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.181168 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe291a4-677c-4031-8414-9b701631a8fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:06.181515 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe291a4-677c-4031-8414-9b701631a8fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.183144 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe291a4-677c-4031-8414-9b701631a8fc admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.188268 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 619/1246] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:06 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:06.192321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92023f9-e23a-476a-9eb9-429fcfa8ebc3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.195103 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 628/1247] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:06.195913 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe291a4-677c-4031-8414-9b701631a8fc admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.200275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92023f9-e23a-476a-9eb9-429fcfa8ebc3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.205969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cedc5-5b20-493e-8280-e6b8affd1e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.206179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe291a4-677c-4031-8414-9b701631a8fc admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.206580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cedc5-5b20-493e-8280-e6b8affd1e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.206860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cedc5-5b20-493e-8280-e6b8affd1e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.207130 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cedc5-5b20-493e-8280-e6b8affd1e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.207804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cedc5-5b20-493e-8280-e6b8affd1e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:06.208095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cedc5-5b20-493e-8280-e6b8affd1e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.209992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cedc5-5b20-493e-8280-e6b8affd1e46 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.212500 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e8605-87e1-4041-a16a-1be1f4825069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.213124 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e8605-87e1-4041-a16a-1be1f4825069 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.213418 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e8605-87e1-4041-a16a-1be1f4825069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.213741 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e8605-87e1-4041-a16a-1be1f4825069 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.214378 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e8605-87e1-4041-a16a-1be1f4825069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:06.215266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e8605-87e1-4041-a16a-1be1f4825069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.216887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e8605-87e1-4041-a16a-1be1f4825069 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.224546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 620/1248] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:06.225401 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cedc5-5b20-493e-8280-e6b8affd1e46 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.236710 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cedc5-5b20-493e-8280-e6b8affd1e46 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.238611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 629/1249] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:06.241746 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ddd3b-18f8-46c7-b1c3-a43616f4086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.242400 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ddd3b-18f8-46c7-b1c3-a43616f4086c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.242684 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ddd3b-18f8-46c7-b1c3-a43616f4086c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.243014 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ddd3b-18f8-46c7-b1c3-a43616f4086c admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.243953 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ddd3b-18f8-46c7-b1c3-a43616f4086c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.246116 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ddd3b-18f8-46c7-b1c3-a43616f4086c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.246850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2cba0-6d6a-488b-8a8d-f22dd5bd05d3 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.247130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2cba0-6d6a-488b-8a8d-f22dd5bd05d3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.247446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2cba0-6d6a-488b-8a8d-f22dd5bd05d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.275218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-fab2cba0-6d6a-488b-8a8d-f22dd5bd05d3 None None] MFA Rules not processed for user `62088e8d368349bfab1b603df1aed98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:06.276370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-fab2cba0-6d6a-488b-8a8d-f22dd5bd05d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:06.301323 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:06.339974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 630/1250] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:06.340954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2cba0-6d6a-488b-8a8d-f22dd5bd05d3 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.352535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2cba0-6d6a-488b-8a8d-f22dd5bd05d3 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.357066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaf14c-c483-4431-93a4-afd03ad02947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.357690 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaf14c-c483-4431-93a4-afd03ad02947 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.357968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaf14c-c483-4431-93a4-afd03ad02947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.358237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaf14c-c483-4431-93a4-afd03ad02947 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.358860 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaf14c-c483-4431-93a4-afd03ad02947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.361461 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaf14c-c483-4431-93a4-afd03ad02947 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.412685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 621/1251] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:06 2022] POST /identity/v3/users => generated 303 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:06.413014 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ddd3b-18f8-46c7-b1c3-a43616f4086c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.422489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ddd3b-18f8-46c7-b1c3-a43616f4086c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.428027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786de95c-1c48-426e-acda-d8d624a2ac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.428597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786de95c-1c48-426e-acda-d8d624a2ac64 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.428877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786de95c-1c48-426e-acda-d8d624a2ac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.429148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786de95c-1c48-426e-acda-d8d624a2ac64 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.429791 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786de95c-1c48-426e-acda-d8d624a2ac64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.431706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786de95c-1c48-426e-acda-d8d624a2ac64 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.486044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 631/1252] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:06 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:06.487033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaf14c-c483-4431-93a4-afd03ad02947 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.542677 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:06.548581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaf14c-c483-4431-93a4-afd03ad02947 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.548738 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 622/1253] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:06 2022] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:06.549431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786de95c-1c48-426e-acda-d8d624a2ac64 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.554621 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c448ec-7e9d-41c2-aa27-d7917980541f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.556537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c448ec-7e9d-41c2-aa27-d7917980541f admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.556537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c448ec-7e9d-41c2-aa27-d7917980541f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.556537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c448ec-7e9d-41c2-aa27-d7917980541f admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.556537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c448ec-7e9d-41c2-aa27-d7917980541f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.558060 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c448ec-7e9d-41c2-aa27-d7917980541f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.561340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786de95c-1c48-426e-acda-d8d624a2ac64 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.566946 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafd541-733c-4045-bf62-ddd61017ce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.567563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd541-733c-4045-bf62-ddd61017ce44 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.567868 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd541-733c-4045-bf62-ddd61017ce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.568142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafd541-733c-4045-bf62-ddd61017ce44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.571564 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 632/1254] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:06.571732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafd541-733c-4045-bf62-ddd61017ce44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.571844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c448ec-7e9d-41c2-aa27-d7917980541f admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.571933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafd541-733c-4045-bf62-ddd61017ce44 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.581601 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c448ec-7e9d-41c2-aa27-d7917980541f admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.586195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db12efc-f79a-4e0a-870c-0b936c22ad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.594293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db12efc-f79a-4e0a-870c-0b936c22ad85 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.594293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db12efc-f79a-4e0a-870c-0b936c22ad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.594293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db12efc-f79a-4e0a-870c-0b936c22ad85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.594293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db12efc-f79a-4e0a-870c-0b936c22ad85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.594293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db12efc-f79a-4e0a-870c-0b936c22ad85 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.732512 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 623/1255] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:06 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:06.733535 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafd541-733c-4045-bf62-ddd61017ce44 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.761074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 633/1256] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:06 2022] POST /identity/v3/projects => generated 389 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:06.762509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db12efc-f79a-4e0a-870c-0b936c22ad85 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.796992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafd541-733c-4045-bf62-ddd61017ce44 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.817888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db12efc-f79a-4e0a-870c-0b936c22ad85 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.821570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f13d9-0822-4f41-8785-7429e3cd2f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.822170 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f13d9-0822-4f41-8785-7429e3cd2f03 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.822451 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f13d9-0822-4f41-8785-7429e3cd2f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.822714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f13d9-0822-4f41-8785-7429e3cd2f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.854062 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:06.854592 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17551e26-1572-41ed-849b-a9306bedb378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.855207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17551e26-1572-41ed-849b-a9306bedb378 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.855488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17551e26-1572-41ed-849b-a9306bedb378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.855763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17551e26-1572-41ed-849b-a9306bedb378 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.856404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17551e26-1572-41ed-849b-a9306bedb378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.858348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17551e26-1572-41ed-849b-a9306bedb378 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.880333 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f13d9-0822-4f41-8785-7429e3cd2f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.881831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f13d9-0822-4f41-8785-7429e3cd2f03 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.890481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 634/1257] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:06.891327 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f13d9-0822-4f41-8785-7429e3cd2f03 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.902563 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f13d9-0822-4f41-8785-7429e3cd2f03 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.907306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b8b92-9fdb-434a-852c-32a5aa48b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.907901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b8b92-9fdb-434a-852c-32a5aa48b38a admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.908181 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b8b92-9fdb-434a-852c-32a5aa48b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.908444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b8b92-9fdb-434a-852c-32a5aa48b38a admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.909075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b8b92-9fdb-434a-852c-32a5aa48b38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.910679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b8b92-9fdb-434a-852c-32a5aa48b38a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.921398 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 635/1258] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:06.922248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b8b92-9fdb-434a-852c-32a5aa48b38a admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:06.932182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b8b92-9fdb-434a-852c-32a5aa48b38a admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:06.936832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc24e5-a4fb-4d32-94de-631a5a5652c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:06.948050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc24e5-a4fb-4d32-94de-631a5a5652c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:06.948050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc24e5-a4fb-4d32-94de-631a5a5652c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:06.948050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc24e5-a4fb-4d32-94de-631a5a5652c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:06.948050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc24e5-a4fb-4d32-94de-631a5a5652c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:06.948050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: WARNING py.warnings [None req-4fdc24e5-a4fb-4d32-94de-631a5a5652c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:09:06.948050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: warnings.warn(msg) Oct 31 15:09:06.948050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: Oct 31 15:09:06.948604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc24e5-a4fb-4d32-94de-631a5a5652c5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:06.972458 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 624/1259] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:06 2022] POST /identity/v3/projects => generated 373 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:06.973343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17551e26-1572-41ed-849b-a9306bedb378 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.033648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 636/1260] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:06 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:07.034719 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc24e5-a4fb-4d32-94de-631a5a5652c5 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.043670 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17551e26-1572-41ed-849b-a9306bedb378 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.046798 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc24e5-a4fb-4d32-94de-631a5a5652c5 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.048715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4092b-e39b-421f-8dd2-f2c0a25d66ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.049137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4092b-e39b-421f-8dd2-f2c0a25d66ce admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.049713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4092b-e39b-421f-8dd2-f2c0a25d66ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.049982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4092b-e39b-421f-8dd2-f2c0a25d66ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.050626 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4092b-e39b-421f-8dd2-f2c0a25d66ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.052481 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4092b-e39b-421f-8dd2-f2c0a25d66ce admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.053103 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337e455-260f-42c1-8b89-489029f99903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.053671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337e455-260f-42c1-8b89-489029f99903 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.054010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337e455-260f-42c1-8b89-489029f99903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.054286 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337e455-260f-42c1-8b89-489029f99903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.054979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337e455-260f-42c1-8b89-489029f99903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.056593 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337e455-260f-42c1-8b89-489029f99903 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.063933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 625/1261] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:07.064601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4092b-e39b-421f-8dd2-f2c0a25d66ce admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.068705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 637/1262] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:07.071281 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:07.072644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337e455-260f-42c1-8b89-489029f99903 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.075375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4092b-e39b-421f-8dd2-f2c0a25d66ce admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.080888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82e628-2538-4e17-9709-4bafc21dcb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.081521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82e628-2538-4e17-9709-4bafc21dcb9d admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.081804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82e628-2538-4e17-9709-4bafc21dcb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.082074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82e628-2538-4e17-9709-4bafc21dcb9d admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.082701 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82e628-2538-4e17-9709-4bafc21dcb9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.083783 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337e455-260f-42c1-8b89-489029f99903 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.084640 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82e628-2538-4e17-9709-4bafc21dcb9d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.089768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f2575-b263-4261-8a49-cb8f06a69e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.090447 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2575-b263-4261-8a49-cb8f06a69e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.090788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2575-b263-4261-8a49-cb8f06a69e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.091153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f2575-b263-4261-8a49-cb8f06a69e69 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.091831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f2575-b263-4261-8a49-cb8f06a69e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.093977 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f2575-b263-4261-8a49-cb8f06a69e69 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.244734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 626/1263] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:07 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:07.246840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82e628-2538-4e17-9709-4bafc21dcb9d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.257716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82e628-2538-4e17-9709-4bafc21dcb9d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.262657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bc7c0-c848-4135-b36e-357986dbbd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.263249 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bc7c0-c848-4135-b36e-357986dbbd04 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.263522 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bc7c0-c848-4135-b36e-357986dbbd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.263792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bc7c0-c848-4135-b36e-357986dbbd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.264421 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bc7c0-c848-4135-b36e-357986dbbd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.266112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bc7c0-c848-4135-b36e-357986dbbd04 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.277643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 627/1264] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:07.278404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bc7c0-c848-4135-b36e-357986dbbd04 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.287998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bc7c0-c848-4135-b36e-357986dbbd04 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.296949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30a314-c240-40ef-a7d7-13dd276f057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.296949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30a314-c240-40ef-a7d7-13dd276f057d admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.296949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30a314-c240-40ef-a7d7-13dd276f057d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.296949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30a314-c240-40ef-a7d7-13dd276f057d admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.297402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30a314-c240-40ef-a7d7-13dd276f057d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.297402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30a314-c240-40ef-a7d7-13dd276f057d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.317835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 638/1265] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:07 2022] POST /identity/v3/users => generated 295 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:07.317835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f2575-b263-4261-8a49-cb8f06a69e69 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.327714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f2575-b263-4261-8a49-cb8f06a69e69 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.333011 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d1833-0217-47c3-b74f-22370cd828b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.333886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d1833-0217-47c3-b74f-22370cd828b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.333886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d1833-0217-47c3-b74f-22370cd828b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.333886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d1833-0217-47c3-b74f-22370cd828b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.334479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d1833-0217-47c3-b74f-22370cd828b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.336076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d1833-0217-47c3-b74f-22370cd828b4 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.347047 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 639/1266] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:07.347869 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d1833-0217-47c3-b74f-22370cd828b4 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.358869 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d1833-0217-47c3-b74f-22370cd828b4 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.364612 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d906d-8fd0-48fc-8cba-13b12fad77b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.365241 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d906d-8fd0-48fc-8cba-13b12fad77b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.368326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d906d-8fd0-48fc-8cba-13b12fad77b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.368326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d906d-8fd0-48fc-8cba-13b12fad77b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.368326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d906d-8fd0-48fc-8cba-13b12fad77b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.368326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d906d-8fd0-48fc-8cba-13b12fad77b8 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.379699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 640/1267] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:07.380503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d906d-8fd0-48fc-8cba-13b12fad77b8 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.390607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d906d-8fd0-48fc-8cba-13b12fad77b8 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.394755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 628/1268] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:07 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:07.397206 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e378d8-b955-43e8-b74b-9f5bc825b27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.397367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30a314-c240-40ef-a7d7-13dd276f057d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.397464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e378d8-b955-43e8-b74b-9f5bc825b27e admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.397464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e378d8-b955-43e8-b74b-9f5bc825b27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.397464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e378d8-b955-43e8-b74b-9f5bc825b27e admin admin] PATH_INFO: `/v3/projects/88b1739a165147a0a3781362836d137b/users/e5109f4de7554ecf9840ff6922eb05fa/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.405526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30a314-c240-40ef-a7d7-13dd276f057d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.412093 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bcac1-fb16-4bec-a3c6-ab316b66460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.412596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e378d8-b955-43e8-b74b-9f5bc825b27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b1739a165147a0a3781362836d137b, user_id=e5109f4de7554ecf9840ff6922eb05fa, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.412787 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bcac1-fb16-4bec-a3c6-ab316b66460c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.413073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bcac1-fb16-4bec-a3c6-ab316b66460c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.413379 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bcac1-fb16-4bec-a3c6-ab316b66460c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.414106 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655bcac1-fb16-4bec-a3c6-ab316b66460c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.415253 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e378d8-b955-43e8-b74b-9f5bc825b27e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.415684 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655bcac1-fb16-4bec-a3c6-ab316b66460c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.428926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 629/1269] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:07.428926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bcac1-fb16-4bec-a3c6-ab316b66460c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.440109 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bcac1-fb16-4bec-a3c6-ab316b66460c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.444716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa37164-9e8e-4f92-a94e-607e3143db91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.445393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa37164-9e8e-4f92-a94e-607e3143db91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.445674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa37164-9e8e-4f92-a94e-607e3143db91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.445944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa37164-9e8e-4f92-a94e-607e3143db91 admin admin] PATH_INFO: `/v3/projects/fa951e0dedc64a38b4dd516e5b614a1a/users/f7e1533e050f4ae38c3ad3ad79150c05/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.460593 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa37164-9e8e-4f92-a94e-607e3143db91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa951e0dedc64a38b4dd516e5b614a1a, user_id=f7e1533e050f4ae38c3ad3ad79150c05, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.463199 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa37164-9e8e-4f92-a94e-607e3143db91 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.535496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 641/1270] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:07 2022] PUT /identity/v3/projects/88b1739a165147a0a3781362836d137b/users/e5109f4de7554ecf9840ff6922eb05fa/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:07.536407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e378d8-b955-43e8-b74b-9f5bc825b27e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.566553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 630/1271] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:07 2022] PUT /identity/v3/projects/fa951e0dedc64a38b4dd516e5b614a1a/users/f7e1533e050f4ae38c3ad3ad79150c05/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:07.572539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa37164-9e8e-4f92-a94e-607e3143db91 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.601927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e378d8-b955-43e8-b74b-9f5bc825b27e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.631466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa37164-9e8e-4f92-a94e-607e3143db91 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.635524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:07.636107 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdc3b3-3c95-4c16-893c-391865d4316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.636893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdc3b3-3c95-4c16-893c-391865d4316e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.637170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdc3b3-3c95-4c16-893c-391865d4316e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.637509 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdc3b3-3c95-4c16-893c-391865d4316e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.638158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdc3b3-3c95-4c16-893c-391865d4316e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.639928 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdc3b3-3c95-4c16-893c-391865d4316e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.650942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 631/1272] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:07.651559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdc3b3-3c95-4c16-893c-391865d4316e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.664119 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdc3b3-3c95-4c16-893c-391865d4316e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.666551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02d3fe-942e-4180-af28-e9a4eb6034a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.667163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02d3fe-942e-4180-af28-e9a4eb6034a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.667444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02d3fe-942e-4180-af28-e9a4eb6034a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.667716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02d3fe-942e-4180-af28-e9a4eb6034a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.668354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02d3fe-942e-4180-af28-e9a4eb6034a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.669572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89dac1-af65-4a67-bcbe-aae4ae68c01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.669999 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02d3fe-942e-4180-af28-e9a4eb6034a9 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.670220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89dac1-af65-4a67-bcbe-aae4ae68c01a admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.670505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89dac1-af65-4a67-bcbe-aae4ae68c01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.670781 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89dac1-af65-4a67-bcbe-aae4ae68c01a admin admin] PATH_INFO: `/v3/projects/f748698459024d7494f6f9003c2e065a/users/4adb546848a744b3a3ed4d77bc02c0c6/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.681023 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 642/1273] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:07.682760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02d3fe-942e-4180-af28-e9a4eb6034a9 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.689428 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89dac1-af65-4a67-bcbe-aae4ae68c01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f748698459024d7494f6f9003c2e065a, user_id=4adb546848a744b3a3ed4d77bc02c0c6, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.691411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02d3fe-942e-4180-af28-e9a4eb6034a9 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.692171 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89dac1-af65-4a67-bcbe-aae4ae68c01a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.696083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc9676-6fe3-4cc3-971b-cc663950e17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.696663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9676-6fe3-4cc3-971b-cc663950e17c admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.696941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9676-6fe3-4cc3-971b-cc663950e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.697211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9676-6fe3-4cc3-971b-cc663950e17c admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.697868 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc9676-6fe3-4cc3-971b-cc663950e17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.699522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc9676-6fe3-4cc3-971b-cc663950e17c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.709430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 643/1274] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:07.710254 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc9676-6fe3-4cc3-971b-cc663950e17c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.720920 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc9676-6fe3-4cc3-971b-cc663950e17c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.725456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7edec-f205-458b-82f6-098175c80b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.726018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7edec-f205-458b-82f6-098175c80b1e admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.726293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7edec-f205-458b-82f6-098175c80b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.726562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7edec-f205-458b-82f6-098175c80b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.727180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7edec-f205-458b-82f6-098175c80b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.728725 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7edec-f205-458b-82f6-098175c80b1e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.739591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 644/1275] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:07.740831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fc633-87da-4e16-ba1b-ba63883f6fd3 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.741110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fc633-87da-4e16-ba1b-ba63883f6fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.741400 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fc633-87da-4e16-ba1b-ba63883f6fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.759052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-ca8fc633-87da-4e16-ba1b-ba63883f6fd3 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:07.760243 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ca8fc633-87da-4e16-ba1b-ba63883f6fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:07.767841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 645/1276] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:07.768979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7971f5-2eba-405e-b8c3-e759dfb3d7ff None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.769259 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7971f5-2eba-405e-b8c3-e759dfb3d7ff None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.769560 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7971f5-2eba-405e-b8c3-e759dfb3d7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.789012 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-be7971f5-2eba-405e-b8c3-e759dfb3d7ff None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:07.790241 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-be7971f5-2eba-405e-b8c3-e759dfb3d7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:07.799083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 646/1277] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:07.799997 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7971f5-2eba-405e-b8c3-e759dfb3d7ff None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.807170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 632/1278] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:07 2022] PUT /identity/v3/projects/f748698459024d7494f6f9003c2e065a/users/4adb546848a744b3a3ed4d77bc02c0c6/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:07.807170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89dac1-af65-4a67-bcbe-aae4ae68c01a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.814118 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7971f5-2eba-405e-b8c3-e759dfb3d7ff None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.867236 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:07.872414 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89dac1-af65-4a67-bcbe-aae4ae68c01a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.873166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d3060-5b24-47df-9332-f9b92d971431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.873861 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d3060-5b24-47df-9332-f9b92d971431 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.874138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d3060-5b24-47df-9332-f9b92d971431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.874406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d3060-5b24-47df-9332-f9b92d971431 admin admin] PATH_INFO: `/v3/projects/cd9c311deda54ddf9eac5bec33176932/users/7f915ab5fe6b4ec1a82b7cc7e62427b5/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.877565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e4b94-4eff-41f5-a488-fd7c9166f3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.878194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e4b94-4eff-41f5-a488-fd7c9166f3ee admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.878471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e4b94-4eff-41f5-a488-fd7c9166f3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.878744 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e4b94-4eff-41f5-a488-fd7c9166f3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.879379 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e4b94-4eff-41f5-a488-fd7c9166f3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.880971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e4b94-4eff-41f5-a488-fd7c9166f3ee admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.889923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d3060-5b24-47df-9332-f9b92d971431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9c311deda54ddf9eac5bec33176932, user_id=7f915ab5fe6b4ec1a82b7cc7e62427b5, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.894849 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 633/1279] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:07.894849 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e4b94-4eff-41f5-a488-fd7c9166f3ee admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.895108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d3060-5b24-47df-9332-f9b92d971431 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.902331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e4b94-4eff-41f5-a488-fd7c9166f3ee admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.907522 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1173e-41a2-49e1-bac8-d879d9d8ed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.913672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1173e-41a2-49e1-bac8-d879d9d8ed31 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.913672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1173e-41a2-49e1-bac8-d879d9d8ed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.913672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1173e-41a2-49e1-bac8-d879d9d8ed31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.913672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1173e-41a2-49e1-bac8-d879d9d8ed31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.913672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1173e-41a2-49e1-bac8-d879d9d8ed31 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:07.921463 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 634/1280] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:07.923392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1173e-41a2-49e1-bac8-d879d9d8ed31 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:07.933699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1173e-41a2-49e1-bac8-d879d9d8ed31 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:07.938656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6abd23-866b-47e9-bd30-16c2c5e659cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:07.939348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6abd23-866b-47e9-bd30-16c2c5e659cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:07.939624 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6abd23-866b-47e9-bd30-16c2c5e659cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:07.939891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6abd23-866b-47e9-bd30-16c2c5e659cd admin admin] PATH_INFO: `/v3/projects/85fa732ab7b64eaab79cfd43d9c2e898/users/093519cbc8564b859c01a3a3ab1aae3d/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:07.961357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6abd23-866b-47e9-bd30-16c2c5e659cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=85fa732ab7b64eaab79cfd43d9c2e898, user_id=093519cbc8564b859c01a3a3ab1aae3d, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:07.967669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6abd23-866b-47e9-bd30-16c2c5e659cd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:08.004779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 647/1281] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:07 2022] PUT /identity/v3/projects/cd9c311deda54ddf9eac5bec33176932/users/7f915ab5fe6b4ec1a82b7cc7e62427b5/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:08.009324 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d3060-5b24-47df-9332-f9b92d971431 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:08.068196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d3060-5b24-47df-9332-f9b92d971431 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:08.074599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83880a-922d-4678-b9b0-0cd7be2a6e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:08.075203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83880a-922d-4678-b9b0-0cd7be2a6e3e service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.075470 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83880a-922d-4678-b9b0-0cd7be2a6e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.075741 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83880a-922d-4678-b9b0-0cd7be2a6e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.111490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:08.126651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 635/1282] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:07 2022] PUT /identity/v3/projects/85fa732ab7b64eaab79cfd43d9c2e898/users/093519cbc8564b859c01a3a3ab1aae3d/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:08.126651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6abd23-866b-47e9-bd30-16c2c5e659cd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:08.145199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83880a-922d-4678-b9b0-0cd7be2a6e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:08.146859 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83880a-922d-4678-b9b0-0cd7be2a6e3e service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:08.164504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 648/1283] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:08.167579 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a51bbc-40f6-41d8-8f93-12dae379b10d None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.167904 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a51bbc-40f6-41d8-8f93-12dae379b10d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.169857 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a51bbc-40f6-41d8-8f93-12dae379b10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.190310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6abd23-866b-47e9-bd30-16c2c5e659cd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:08.194447 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a222c3-243a-4ce2-9c6a-f64fbd16d109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:08.195173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a222c3-243a-4ce2-9c6a-f64fbd16d109 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.195545 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a222c3-243a-4ce2-9c6a-f64fbd16d109 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.195929 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a222c3-243a-4ce2-9c6a-f64fbd16d109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.197508 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f4a51bbc-40f6-41d8-8f93-12dae379b10d None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:08.198839 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f4a51bbc-40f6-41d8-8f93-12dae379b10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:08.261800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a222c3-243a-4ce2-9c6a-f64fbd16d109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:08.262765 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 649/1284] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:08.263261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a222c3-243a-4ce2-9c6a-f64fbd16d109 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:08.263670 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a51bbc-40f6-41d8-8f93-12dae379b10d None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:08.273296 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a51bbc-40f6-41d8-8f93-12dae379b10d None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:08.273557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 636/1285] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:08.274461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a222c3-243a-4ce2-9c6a-f64fbd16d109 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:08.278177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6949b-a98e-4856-a560-5eb7245a0129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:08.278824 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6949b-a98e-4856-a560-5eb7245a0129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.279093 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6949b-a98e-4856-a560-5eb7245a0129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.279358 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6949b-a98e-4856-a560-5eb7245a0129 admin admin] PATH_INFO: `/v3/projects/3620948adaa843ae995e58313d8d9b1c/users/5d83b424ffbc4a879b490d9ac6e84ef5/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.284991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a222c3-243a-4ce2-9c6a-f64fbd16d109 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:08.289651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1c187-2412-42b7-b17c-ef8fe575df0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:08.290391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c187-2412-42b7-b17c-ef8fe575df0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.290672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c187-2412-42b7-b17c-ef8fe575df0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.290939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1c187-2412-42b7-b17c-ef8fe575df0c admin admin] PATH_INFO: `/v3/projects/b5b16e5042be422faffbf884a13ca3c8/users/c8ed8037688f4b78b0c74dc638e81366/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.301537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6949b-a98e-4856-a560-5eb7245a0129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3620948adaa843ae995e58313d8d9b1c, user_id=5d83b424ffbc4a879b490d9ac6e84ef5, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:08.304436 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6949b-a98e-4856-a560-5eb7245a0129 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:08.307942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1c187-2412-42b7-b17c-ef8fe575df0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b16e5042be422faffbf884a13ca3c8, user_id=c8ed8037688f4b78b0c74dc638e81366, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:08.310621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1c187-2412-42b7-b17c-ef8fe575df0c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:08.388629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 637/1286] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:08 2022] PUT /identity/v3/projects/b5b16e5042be422faffbf884a13ca3c8/users/c8ed8037688f4b78b0c74dc638e81366/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:08.393249 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 650/1287] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:08 2022] PUT /identity/v3/projects/3620948adaa843ae995e58313d8d9b1c/users/5d83b424ffbc4a879b490d9ac6e84ef5/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:08.394274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a796-41dc-4a65-a024-768d5bd5b79d None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.394700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a796-41dc-4a65-a024-768d5bd5b79d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.395099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966a796-41dc-4a65-a024-768d5bd5b79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.399827 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d735a1-8a87-4f68-a87d-03c2a5c17b51 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.400113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d735a1-8a87-4f68-a87d-03c2a5c17b51 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.400398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d735a1-8a87-4f68-a87d-03c2a5c17b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.417261 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-5966a796-41dc-4a65-a024-768d5bd5b79d None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:08.418508 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5966a796-41dc-4a65-a024-768d5bd5b79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:08.422080 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-06d735a1-8a87-4f68-a87d-03c2a5c17b51 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:08.427680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-06d735a1-8a87-4f68-a87d-03c2a5c17b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:08.477028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:08.496158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 651/1288] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:08.497172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966a796-41dc-4a65-a024-768d5bd5b79d None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:08.506194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 638/1289] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:08.507727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af13428-bc15-46b9-97f3-385561b22484 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.508108 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af13428-bc15-46b9-97f3-385561b22484 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.508385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af13428-bc15-46b9-97f3-385561b22484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.528144 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5af13428-bc15-46b9-97f3-385561b22484 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:08.529777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5af13428-bc15-46b9-97f3-385561b22484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:08.539547 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 639/1290] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:08.540911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea135cad-ddbf-4835-bfac-01918fe2e2f4 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.541198 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea135cad-ddbf-4835-bfac-01918fe2e2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.541498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea135cad-ddbf-4835-bfac-01918fe2e2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.575675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ea135cad-ddbf-4835-bfac-01918fe2e2f4 None None] MFA Rules not processed for user `c8ed8037688f4b78b0c74dc638e81366`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:08.577078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ea135cad-ddbf-4835-bfac-01918fe2e2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:08.581310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:08.588992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966a796-41dc-4a65-a024-768d5bd5b79d None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:08.592676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd6039-775e-45fe-9945-f5df246eb2d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:08.593244 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd6039-775e-45fe-9945-f5df246eb2d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.593667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd6039-775e-45fe-9945-f5df246eb2d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.593939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd6039-775e-45fe-9945-f5df246eb2d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.608330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd6039-775e-45fe-9945-f5df246eb2d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:08.611137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd6039-775e-45fe-9945-f5df246eb2d9 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:08.621141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 652/1291] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:08.621847 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd6039-775e-45fe-9945-f5df246eb2d9 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:08.631429 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd6039-775e-45fe-9945-f5df246eb2d9 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:08.637108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaefd90-a801-413b-9f6e-3d6917cba8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:08.637937 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaefd90-a801-413b-9f6e-3d6917cba8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.638219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaefd90-a801-413b-9f6e-3d6917cba8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.638592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaefd90-a801-413b-9f6e-3d6917cba8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.655343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 640/1292] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:08.656074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea135cad-ddbf-4835-bfac-01918fe2e2f4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:08.660605 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaefd90-a801-413b-9f6e-3d6917cba8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:08.671337 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea135cad-ddbf-4835-bfac-01918fe2e2f4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:08.678919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23244ab2-09cc-4075-8143-deeee94810c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:08.679860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244ab2-09cc-4075-8143-deeee94810c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.680208 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244ab2-09cc-4075-8143-deeee94810c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.680648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244ab2-09cc-4075-8143-deeee94810c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.681674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaefd90-a801-413b-9f6e-3d6917cba8a7 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:08.692864 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23244ab2-09cc-4075-8143-deeee94810c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:08.695133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23244ab2-09cc-4075-8143-deeee94810c1 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:08.704119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 653/1293] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:08.706620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaefd90-a801-413b-9f6e-3d6917cba8a7 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:08.709702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 641/1294] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:08.711174 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d87d4-73e7-4d49-a62b-efe6f4ac8f77 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.711482 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d87d4-73e7-4d49-a62b-efe6f4ac8f77 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.712026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d87d4-73e7-4d49-a62b-efe6f4ac8f77 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.713489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 642/1295] 10.222.0.45 () {54 vars in 961 bytes} [Mon Oct 31 15:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:09:08.719084 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaefd90-a801-413b-9f6e-3d6917cba8a7 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:08.723803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613b430-49b2-4853-ba1c-684612be9549 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.724475 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613b430-49b2-4853-ba1c-684612be9549 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.725213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613b430-49b2-4853-ba1c-684612be9549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.726927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf218e-176e-4bcc-ad11-75f84f49329d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:08.727566 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf218e-176e-4bcc-ad11-75f84f49329d service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.727897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf218e-176e-4bcc-ad11-75f84f49329d service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.728415 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf218e-176e-4bcc-ad11-75f84f49329d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.739250 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf218e-176e-4bcc-ad11-75f84f49329d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:08.740746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf218e-176e-4bcc-ad11-75f84f49329d service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:08.756889 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 654/1296] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:08.792294 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4613b430-49b2-4853-ba1c-684612be9549 None None] MFA Rules not processed for user `9ec30e419d6f4fddb05c4bb08f2ce3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:08.793762 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4613b430-49b2-4853-ba1c-684612be9549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:08.873823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 643/1297] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Oct 31 15:09:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:08.883316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf218e-176e-4bcc-ad11-75f84f49329d service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:08.901482 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf218e-176e-4bcc-ad11-75f84f49329d service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:08.909770 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d37f63-8099-4650-8294-3ec9ac239bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:08.910211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d37f63-8099-4650-8294-3ec9ac239bd1 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:08.910552 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d37f63-8099-4650-8294-3ec9ac239bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:08.910893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d37f63-8099-4650-8294-3ec9ac239bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:08.921776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d37f63-8099-4650-8294-3ec9ac239bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:08.924541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d37f63-8099-4650-8294-3ec9ac239bd1 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:08.937638 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 655/1298] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:09.195035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c7204-2e32-410b-a4f1-ac2256718a13 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:09.195799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c7204-2e32-410b-a4f1-ac2256718a13 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:09.196082 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c7204-2e32-410b-a4f1-ac2256718a13 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:09.198433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 644/1299] 10.222.0.45 () {54 vars in 912 bytes} [Mon Oct 31 15:09:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:09:09.205113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773c45d-1543-47e4-9e24-3c9a1b408957 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:09.205113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773c45d-1543-47e4-9e24-3c9a1b408957 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:09.205373 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773c45d-1543-47e4-9e24-3c9a1b408957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:09.240083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-c773c45d-1543-47e4-9e24-3c9a1b408957 None None] MFA Rules not processed for user `9ec30e419d6f4fddb05c4bb08f2ce3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:09.241168 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c773c45d-1543-47e4-9e24-3c9a1b408957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:09.253020 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 656/1300] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:09:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:09.267556 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c7204-2e32-410b-a4f1-ac2256718a13 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:09.305549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:09.332078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c7204-2e32-410b-a4f1-ac2256718a13 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:09.337089 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281bff1-fa86-43ae-86f6-7bd7ad6b472c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:09.337732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281bff1-fa86-43ae-86f6-7bd7ad6b472c service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:09.338009 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281bff1-fa86-43ae-86f6-7bd7ad6b472c service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:09.338274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281bff1-fa86-43ae-86f6-7bd7ad6b472c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:09.349815 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281bff1-fa86-43ae-86f6-7bd7ad6b472c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:09.351239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281bff1-fa86-43ae-86f6-7bd7ad6b472c service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:09.362160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 645/1301] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:10.630542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49a13a-1c82-4ed7-9aa6-46db37800c02 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:10.631097 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49a13a-1c82-4ed7-9aa6-46db37800c02 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:10.631097 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49a13a-1c82-4ed7-9aa6-46db37800c02 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:10.632435 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 657/1302] 10.222.0.45 () {54 vars in 961 bytes} [Mon Oct 31 15:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:09:10.645066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52675509-c7ed-4ab4-a5e4-6c9afeacecc7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:10.645066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52675509-c7ed-4ab4-a5e4-6c9afeacecc7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:10.645577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52675509-c7ed-4ab4-a5e4-6c9afeacecc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:10.692843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-52675509-c7ed-4ab4-a5e4-6c9afeacecc7 None None] MFA Rules not processed for user `9ec30e419d6f4fddb05c4bb08f2ce3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:10.694098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-52675509-c7ed-4ab4-a5e4-6c9afeacecc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:10.728984 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 646/1303] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Oct 31 15:09:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:09:10.730235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c005da4-9a71-47fd-9068-45432223f736 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:10.730517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c005da4-9a71-47fd-9068-45432223f736 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:10.730791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c005da4-9a71-47fd-9068-45432223f736 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:10.732116 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 658/1304] 10.222.0.45 () {54 vars in 912 bytes} [Mon Oct 31 15:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:09:10.738891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bb754-bc4d-4b23-9df4-946dd4e80e01 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:10.739390 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bb754-bc4d-4b23-9df4-946dd4e80e01 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:10.739942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bb754-bc4d-4b23-9df4-946dd4e80e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:10.761750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1d8bb754-bc4d-4b23-9df4-946dd4e80e01 None None] MFA Rules not processed for user `9ec30e419d6f4fddb05c4bb08f2ce3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:10.763392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1d8bb754-bc4d-4b23-9df4-946dd4e80e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:10.783790 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 647/1305] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:09:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:10.792226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c005da4-9a71-47fd-9068-45432223f736 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:10.810776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c005da4-9a71-47fd-9068-45432223f736 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:10.816420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4de93-73af-4edf-8584-d62c34dabb5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:10.817261 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4de93-73af-4edf-8584-d62c34dabb5a service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:10.817893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4de93-73af-4edf-8584-d62c34dabb5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:10.818310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4de93-73af-4edf-8584-d62c34dabb5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:10.834564 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4de93-73af-4edf-8584-d62c34dabb5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:10.836996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4de93-73af-4edf-8584-d62c34dabb5a service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:10.861493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 659/1306] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:11.089237 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc0760-2c38-4bd8-bc97-04c8b52ab327 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:11.095128 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc0760-2c38-4bd8-bc97-04c8b52ab327 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:11.095128 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc0760-2c38-4bd8-bc97-04c8b52ab327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:11.143692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-96fc0760-2c38-4bd8-bc97-04c8b52ab327 None None] MFA Rules not processed for user `f7e1533e050f4ae38c3ad3ad79150c05`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:11.145740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-96fc0760-2c38-4bd8-bc97-04c8b52ab327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:11.270777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 648/1307] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:11 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:11.275387 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4de93-73af-4edf-8584-d62c34dabb5a service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:11.299821 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4de93-73af-4edf-8584-d62c34dabb5a service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:11.307375 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b3176-b2c7-46e6-a343-0bd2c7b3031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:11.307375 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b3176-b2c7-46e6-a343-0bd2c7b3031d admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:11.307912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b3176-b2c7-46e6-a343-0bd2c7b3031d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:11.308603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b3176-b2c7-46e6-a343-0bd2c7b3031d admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:11.310236 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b3176-b2c7-46e6-a343-0bd2c7b3031d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:11.312385 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b3176-b2c7-46e6-a343-0bd2c7b3031d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:11.478263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 660/1308] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:11 2022] POST /identity/v3/projects => generated 405 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:11.479353 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc0760-2c38-4bd8-bc97-04c8b52ab327 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:11.479353 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc0760-2c38-4bd8-bc97-04c8b52ab327 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:11.570362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe87b2-4653-4c9a-a5e6-afa296127ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:11.571361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe87b2-4653-4c9a-a5e6-afa296127ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:11.571652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe87b2-4653-4c9a-a5e6-afa296127ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:11.571923 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe87b2-4653-4c9a-a5e6-afa296127ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:11.572621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe87b2-4653-4c9a-a5e6-afa296127ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:11.574825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe87b2-4653-4c9a-a5e6-afa296127ce4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:11.739336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b3176-b2c7-46e6-a343-0bd2c7b3031d admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:11.743811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 649/1309] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:11 2022] POST /identity/v3/users => generated 309 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:11.760336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b3176-b2c7-46e6-a343-0bd2c7b3031d admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:11.773269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa93f6-4ea0-4492-8b83-09d6078e592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:11.773916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa93f6-4ea0-4492-8b83-09d6078e592d admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:11.774238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa93f6-4ea0-4492-8b83-09d6078e592d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:11.774508 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa93f6-4ea0-4492-8b83-09d6078e592d admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:11.775156 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa93f6-4ea0-4492-8b83-09d6078e592d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:11.776747 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa93f6-4ea0-4492-8b83-09d6078e592d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:11.795770 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 661/1310] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:11.801075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe87b2-4653-4c9a-a5e6-afa296127ce4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:11.818083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe87b2-4653-4c9a-a5e6-afa296127ce4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:11.835665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1b816-ce2b-497d-bc72-95003646a76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:11.835665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1b816-ce2b-497d-bc72-95003646a76c admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:11.835665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1b816-ce2b-497d-bc72-95003646a76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:11.835665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1b816-ce2b-497d-bc72-95003646a76c admin admin] PATH_INFO: `/v3/projects/6c86c2342e3a4227bdb64236080872a9/users/0f9ae09bcc914621b8598b697b9df3ee/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:11.871553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1b816-ce2b-497d-bc72-95003646a76c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c86c2342e3a4227bdb64236080872a9, user_id=0f9ae09bcc914621b8598b697b9df3ee, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:11.891642 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1b816-ce2b-497d-bc72-95003646a76c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:12.017488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 650/1311] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:11 2022] PUT /identity/v3/projects/6c86c2342e3a4227bdb64236080872a9/users/0f9ae09bcc914621b8598b697b9df3ee/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:09:12.024166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa93f6-4ea0-4492-8b83-09d6078e592d admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:12.041347 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa93f6-4ea0-4492-8b83-09d6078e592d admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:12.191831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5bf34-fe6e-432e-9c1c-9894ab6bf760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:12.192502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5bf34-fe6e-432e-9c1c-9894ab6bf760 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:12.194304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5bf34-fe6e-432e-9c1c-9894ab6bf760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:12.194304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5bf34-fe6e-432e-9c1c-9894ab6bf760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:12.195973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5bf34-fe6e-432e-9c1c-9894ab6bf760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:12.201175 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5bf34-fe6e-432e-9c1c-9894ab6bf760 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:12.238727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1b816-ce2b-497d-bc72-95003646a76c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:12.252630 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1b816-ce2b-497d-bc72-95003646a76c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:12.256053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 662/1312] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:12.277874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e97795-c16d-4e8c-962a-ed112108eab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:12.278624 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e97795-c16d-4e8c-962a-ed112108eab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:12.278972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e97795-c16d-4e8c-962a-ed112108eab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:12.279252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e97795-c16d-4e8c-962a-ed112108eab3 admin admin] PATH_INFO: `/v3/projects/6c86c2342e3a4227bdb64236080872a9/users/0f9ae09bcc914621b8598b697b9df3ee/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:12.281591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e97795-c16d-4e8c-962a-ed112108eab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c86c2342e3a4227bdb64236080872a9, user_id=0f9ae09bcc914621b8598b697b9df3ee, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:12.286472 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e97795-c16d-4e8c-962a-ed112108eab3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:12.310421 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 651/1313] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:12 2022] PUT /identity/v3/projects/6c86c2342e3a4227bdb64236080872a9/users/0f9ae09bcc914621b8598b697b9df3ee/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:13.854158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5bf34-fe6e-432e-9c1c-9894ab6bf760 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:13.871877 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5bf34-fe6e-432e-9c1c-9894ab6bf760 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:14.045613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:14.082995 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:14.086057 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:14.086507 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:14.086785 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] PATH_INFO: `/v3/users/c8ed8037688f4b78b0c74dc638e81366` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:14.090694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ed8037688f4b78b0c74dc638e81366)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:14.095411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:14.470608 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ed8037688f4b78b0c74dc638e81366'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:14.472415 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ed8037688f4b78b0c74dc638e81366'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:14.492659 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ed8037688f4b78b0c74dc638e81366'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:14.493319 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ed8037688f4b78b0c74dc638e81366'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:14.578963 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ed8037688f4b78b0c74dc638e81366'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:14.605238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 663/1314] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:13 2022] DELETE /identity/v3/users/c8ed8037688f4b78b0c74dc638e81366 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:14.610596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bb8e6-8628-49bf-bd64-50b4feb7b9d7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:14.611565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bb8e6-8628-49bf-bd64-50b4feb7b9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:14.612028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bb8e6-8628-49bf-bd64-50b4feb7b9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:14.619552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:14.634337 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-394bb8e6-8628-49bf-bd64-50b4feb7b9d7 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:14.635571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-394bb8e6-8628-49bf-bd64-50b4feb7b9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:14.730220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 652/1315] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:14.799576 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:14.803581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:14.933753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dd5c8-4d73-4d93-ba50-bfd642b338ae admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:14.946736 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5e8e4-9cc6-469c-9cb6-cf761baf38d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:14.950719 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5e8e4-9cc6-469c-9cb6-cf761baf38d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:14.951004 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5e8e4-9cc6-469c-9cb6-cf761baf38d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:14.951276 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5e8e4-9cc6-469c-9cb6-cf761baf38d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:14.976309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5e8e4-9cc6-469c-9cb6-cf761baf38d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:14.979428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5e8e4-9cc6-469c-9cb6-cf761baf38d8 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:15.006996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 664/1316] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:09:16.990921 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bb8e6-8628-49bf-bd64-50b4feb7b9d7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:16.999993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-394bb8e6-8628-49bf-bd64-50b4feb7b9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:17.050074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bb8e6-8628-49bf-bd64-50b4feb7b9d7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:17.059165 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72367726-88ce-493d-a9ba-9ec71b6feb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:17.062378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72367726-88ce-493d-a9ba-9ec71b6feb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:17.062378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72367726-88ce-493d-a9ba-9ec71b6feb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:17.062674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72367726-88ce-493d-a9ba-9ec71b6feb2e admin admin] PATH_INFO: `/v3/projects/b5b16e5042be422faffbf884a13ca3c8` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:17.073364 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72367726-88ce-493d-a9ba-9ec71b6feb2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b16e5042be422faffbf884a13ca3c8)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:17.080515 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72367726-88ce-493d-a9ba-9ec71b6feb2e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:17.286206 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-72367726-88ce-493d-a9ba-9ec71b6feb2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b16e5042be422faffbf884a13ca3c8', 'request_id': 'req-72367726-88ce-493d-a9ba-9ec71b6feb2e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:17.389780 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-72367726-88ce-493d-a9ba-9ec71b6feb2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b16e5042be422faffbf884a13ca3c8', 'request_id': 'req-72367726-88ce-493d-a9ba-9ec71b6feb2e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:17.398758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-72367726-88ce-493d-a9ba-9ec71b6feb2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b16e5042be422faffbf884a13ca3c8', 'request_id': 'req-72367726-88ce-493d-a9ba-9ec71b6feb2e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:17.455274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-72367726-88ce-493d-a9ba-9ec71b6feb2e admin admin] The token cache is being invalidate because project b5b16e5042be422faffbf884a13ca3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:17.455572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-72367726-88ce-493d-a9ba-9ec71b6feb2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:17.456247 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-72367726-88ce-493d-a9ba-9ec71b6feb2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:17.466064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 653/1317] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:16 2022] DELETE /identity/v3/projects/b5b16e5042be422faffbf884a13ca3c8 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:17.469028 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc849b37-2533-45f1-ad34-2eefb0f05653 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:17.469701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc849b37-2533-45f1-ad34-2eefb0f05653 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:17.469701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc849b37-2533-45f1-ad34-2eefb0f05653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:17.548138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-dc849b37-2533-45f1-ad34-2eefb0f05653 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:17.554111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-dc849b37-2533-45f1-ad34-2eefb0f05653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:17.771878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 665/1318] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:17.789219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4913a5-7864-4318-8935-38382a15a68d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:17.789219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4913a5-7864-4318-8935-38382a15a68d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:17.789219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4913a5-7864-4318-8935-38382a15a68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:17.838896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-db4913a5-7864-4318-8935-38382a15a68d None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:17.841436 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-db4913a5-7864-4318-8935-38382a15a68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:17.890060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 654/1319] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:17.890301 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc849b37-2533-45f1-ad34-2eefb0f05653 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:17.901530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc849b37-2533-45f1-ad34-2eefb0f05653 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:17.918137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e8d51-7ad0-4957-adc3-ae4ea9728b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:17.918137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e8d51-7ad0-4957-adc3-ae4ea9728b80 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:17.918137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e8d51-7ad0-4957-adc3-ae4ea9728b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:17.919749 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e8d51-7ad0-4957-adc3-ae4ea9728b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:17.924501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e8d51-7ad0-4957-adc3-ae4ea9728b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:17.925115 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e8d51-7ad0-4957-adc3-ae4ea9728b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:17.934645 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e8d51-7ad0-4957-adc3-ae4ea9728b80 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:17.989868 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 666/1320] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:17.990553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4913a5-7864-4318-8935-38382a15a68d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:18.011613 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4913a5-7864-4318-8935-38382a15a68d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:18.029712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d976e0-fb5c-4e2a-800c-e01d3a4d7c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:18.030252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d976e0-fb5c-4e2a-800c-e01d3a4d7c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:18.032318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d976e0-fb5c-4e2a-800c-e01d3a4d7c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:18.032735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d976e0-fb5c-4e2a-800c-e01d3a4d7c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:18.033245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d976e0-fb5c-4e2a-800c-e01d3a4d7c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:18.042177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d976e0-fb5c-4e2a-800c-e01d3a4d7c50 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:18.117969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4ab7e-423b-4667-a3d9-7bab55625b04 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:18.117969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4ab7e-423b-4667-a3d9-7bab55625b04 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:18.117969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4ab7e-423b-4667-a3d9-7bab55625b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:18.117969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:18.183557 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-14f4ab7e-423b-4667-a3d9-7bab55625b04 None None] MFA Rules not processed for user `0f9ae09bcc914621b8598b697b9df3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:18.184601 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-14f4ab7e-423b-4667-a3d9-7bab55625b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:18.270773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 655/1321] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:17 2022] POST /identity/v3/projects => generated 371 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:18.276772 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d976e0-fb5c-4e2a-800c-e01d3a4d7c50 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:18.424655 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 667/1322] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:18 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:18.456750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:18.457772 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d976e0-fb5c-4e2a-800c-e01d3a4d7c50 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:18.472021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5466b10-c121-4a62-899c-6f293b0fa1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:18.472021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5466b10-c121-4a62-899c-6f293b0fa1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:18.472021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5466b10-c121-4a62-899c-6f293b0fa1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:18.483668 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5466b10-c121-4a62-899c-6f293b0fa1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:18.484390 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5466b10-c121-4a62-899c-6f293b0fa1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:18.486499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5466b10-c121-4a62-899c-6f293b0fa1d3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:18.637398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 656/1323] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:18 2022] POST /identity/v3/users => generated 286 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:18.642184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4ab7e-423b-4667-a3d9-7bab55625b04 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:18.656956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4ab7e-423b-4667-a3d9-7bab55625b04 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:18.672610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896d57d-bca0-47ca-9574-b6039f390fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:18.673249 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896d57d-bca0-47ca-9574-b6039f390fff admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:18.673564 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896d57d-bca0-47ca-9574-b6039f390fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:18.674596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896d57d-bca0-47ca-9574-b6039f390fff admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:18.675282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896d57d-bca0-47ca-9574-b6039f390fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:18.680072 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896d57d-bca0-47ca-9574-b6039f390fff admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:18.715653 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 668/1324] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:18.718798 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5466b10-c121-4a62-899c-6f293b0fa1d3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:18.732559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5466b10-c121-4a62-899c-6f293b0fa1d3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:18.738558 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf219be-df3d-48ab-b56a-c1064e179590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:18.739997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf219be-df3d-48ab-b56a-c1064e179590 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:18.740621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf219be-df3d-48ab-b56a-c1064e179590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:18.740903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf219be-df3d-48ab-b56a-c1064e179590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:18.741809 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf219be-df3d-48ab-b56a-c1064e179590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:18.744371 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf219be-df3d-48ab-b56a-c1064e179590 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:18.772502 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 657/1325] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:18.777563 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896d57d-bca0-47ca-9574-b6039f390fff admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:18.796128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896d57d-bca0-47ca-9574-b6039f390fff admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:18.823565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db98b8-36bc-4046-8b56-136b7f48b9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:18.824545 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db98b8-36bc-4046-8b56-136b7f48b9dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:18.825849 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db98b8-36bc-4046-8b56-136b7f48b9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:18.826682 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db98b8-36bc-4046-8b56-136b7f48b9dd admin admin] PATH_INFO: `/v3/projects/7d5df19dd58344969a677388b7458ccf/users/e858fb6285fe4039a95a5f0578663a63/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:18.877848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db98b8-36bc-4046-8b56-136b7f48b9dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5df19dd58344969a677388b7458ccf, user_id=e858fb6285fe4039a95a5f0578663a63, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:18.883229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db98b8-36bc-4046-8b56-136b7f48b9dd admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:18.975854 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 669/1326] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:18 2022] PUT /identity/v3/projects/7d5df19dd58344969a677388b7458ccf/users/e858fb6285fe4039a95a5f0578663a63/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:18.986987 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b46fe-43f4-4623-97bb-381cd01ba3e8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:18.987654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b46fe-43f4-4623-97bb-381cd01ba3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:18.988147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b46fe-43f4-4623-97bb-381cd01ba3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:19.061750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-287b46fe-43f4-4623-97bb-381cd01ba3e8 None None] MFA Rules not processed for user `e858fb6285fe4039a95a5f0578663a63`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:19.065937 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-287b46fe-43f4-4623-97bb-381cd01ba3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:19.289875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 658/1327] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:19.295007 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db98b8-36bc-4046-8b56-136b7f48b9dd admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:19.460356 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db98b8-36bc-4046-8b56-136b7f48b9dd admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:19.473696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf4293-7951-48b6-99fe-dd0646b50564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:19.482719 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf4293-7951-48b6-99fe-dd0646b50564 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:19.483046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf4293-7951-48b6-99fe-dd0646b50564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:19.488233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf4293-7951-48b6-99fe-dd0646b50564 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:19.488708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf4293-7951-48b6-99fe-dd0646b50564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:19.490936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf4293-7951-48b6-99fe-dd0646b50564 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:19.672355 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 670/1328] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:19 2022] POST /identity/v3/projects => generated 373 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:19.682551 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b46fe-43f4-4623-97bb-381cd01ba3e8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:19.712781 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b46fe-43f4-4623-97bb-381cd01ba3e8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:19.745533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4718c9-9192-4485-92ad-d820d0c89924 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:19.745533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4718c9-9192-4485-92ad-d820d0c89924 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:19.745533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4718c9-9192-4485-92ad-d820d0c89924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:19.812335 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-9f4718c9-9192-4485-92ad-d820d0c89924 None None] MFA Rules not processed for user `e5109f4de7554ecf9840ff6922eb05fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:19.820153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9f4718c9-9192-4485-92ad-d820d0c89924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:19.856432 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a61c6-356f-4eb1-85f1-e276e0454df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:19.857576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a61c6-356f-4eb1-85f1-e276e0454df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:19.859093 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a61c6-356f-4eb1-85f1-e276e0454df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:19.860644 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a61c6-356f-4eb1-85f1-e276e0454df3 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:19.862288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a61c6-356f-4eb1-85f1-e276e0454df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:19.869335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a61c6-356f-4eb1-85f1-e276e0454df3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:19.917112 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:20.009724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 659/1329] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:19 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:20.013827 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a61c6-356f-4eb1-85f1-e276e0454df3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:20.056907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 671/1330] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:20.064616 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4718c9-9192-4485-92ad-d820d0c89924 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:20.067184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9f4718c9-9192-4485-92ad-d820d0c89924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:20.078100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a61c6-356f-4eb1-85f1-e276e0454df3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:20.098147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb6ce9-39e9-41d3-b7ac-37752a9b488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:20.098803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb6ce9-39e9-41d3-b7ac-37752a9b488c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:20.112222 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb6ce9-39e9-41d3-b7ac-37752a9b488c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:20.112618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb6ce9-39e9-41d3-b7ac-37752a9b488c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:20.116414 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb6ce9-39e9-41d3-b7ac-37752a9b488c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:20.119733 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb6ce9-39e9-41d3-b7ac-37752a9b488c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:20.160597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 660/1331] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:20.161970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb6ce9-39e9-41d3-b7ac-37752a9b488c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:20.222426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb6ce9-39e9-41d3-b7ac-37752a9b488c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:20.238927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e86d2-7d61-4415-bb3b-9f7f26dc6e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:20.239620 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e86d2-7d61-4415-bb3b-9f7f26dc6e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:20.239900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e86d2-7d61-4415-bb3b-9f7f26dc6e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:20.240177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e86d2-7d61-4415-bb3b-9f7f26dc6e68 admin admin] PATH_INFO: `/v3/projects/882368fb5eb2463f92746681234fd552/users/82ae53452f9c4a97b23daf00e956b115/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:20.299034 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e86d2-7d61-4415-bb3b-9f7f26dc6e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882368fb5eb2463f92746681234fd552, user_id=82ae53452f9c4a97b23daf00e956b115, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:20.311523 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e86d2-7d61-4415-bb3b-9f7f26dc6e68 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:20.386215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4718c9-9192-4485-92ad-d820d0c89924 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:20.397861 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d8ae9-08f7-4baa-9222-4b0865ee28a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:20.398497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d8ae9-08f7-4baa-9222-4b0865ee28a5 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:20.398776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d8ae9-08f7-4baa-9222-4b0865ee28a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:20.399049 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d8ae9-08f7-4baa-9222-4b0865ee28a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:20.416899 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d8ae9-08f7-4baa-9222-4b0865ee28a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:20.418586 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d8ae9-08f7-4baa-9222-4b0865ee28a5 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:20.440984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 672/1332] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:09:20.456022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 661/1333] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:20 2022] PUT /identity/v3/projects/882368fb5eb2463f92746681234fd552/users/82ae53452f9c4a97b23daf00e956b115/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:20.460111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d8ae9-08f7-4baa-9222-4b0865ee28a5 service nova] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:20.484124 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d8ae9-08f7-4baa-9222-4b0865ee28a5 service nova] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:20.645455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2472b7-5c88-41cd-9850-1abe1b651b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:20.646415 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2472b7-5c88-41cd-9850-1abe1b651b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:20.646855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2472b7-5c88-41cd-9850-1abe1b651b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:20.647504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2472b7-5c88-41cd-9850-1abe1b651b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:20.648745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2472b7-5c88-41cd-9850-1abe1b651b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:20.651186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2472b7-5c88-41cd-9850-1abe1b651b17 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:20.663913 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 673/1334] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:20.667954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e86d2-7d61-4415-bb3b-9f7f26dc6e68 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:20.681870 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e86d2-7d61-4415-bb3b-9f7f26dc6e68 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:20.687186 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d230456-5088-4d86-bc3a-db3e9bf7ed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:20.691570 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d230456-5088-4d86-bc3a-db3e9bf7ed1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:20.695036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d230456-5088-4d86-bc3a-db3e9bf7ed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:20.695036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d230456-5088-4d86-bc3a-db3e9bf7ed1d admin admin] PATH_INFO: `/v3/projects/882368fb5eb2463f92746681234fd552/users/82ae53452f9c4a97b23daf00e956b115/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:20.695784 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d230456-5088-4d86-bc3a-db3e9bf7ed1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=882368fb5eb2463f92746681234fd552, user_id=82ae53452f9c4a97b23daf00e956b115, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:20.701188 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d230456-5088-4d86-bc3a-db3e9bf7ed1d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:20.721874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 662/1335] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:20 2022] PUT /identity/v3/projects/882368fb5eb2463f92746681234fd552/users/82ae53452f9c4a97b23daf00e956b115/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:20.737817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bf54f-dd52-4bea-b8f6-851519745936 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:20.738377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bf54f-dd52-4bea-b8f6-851519745936 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:20.738377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bf54f-dd52-4bea-b8f6-851519745936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:20.796448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-621bf54f-dd52-4bea-b8f6-851519745936 None None] MFA Rules not processed for user `82ae53452f9c4a97b23daf00e956b115`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:20.799476 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-621bf54f-dd52-4bea-b8f6-851519745936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:20.871065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:20.950335 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 674/1336] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:20.971735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d230456-5088-4d86-bc3a-db3e9bf7ed1d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:20.972518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0d230456-5088-4d86-bc3a-db3e9bf7ed1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:20.992592 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:21.110820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ad74f-fff1-457e-aa20-461825980d5f None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:21.111600 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ad74f-fff1-457e-aa20-461825980d5f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:21.117108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ad74f-fff1-457e-aa20-461825980d5f None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:21.117108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 675/1337] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 31 15:09:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 31 15:09:21.123189 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd3e9c-7861-423e-afad-6060767cfe80 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:21.123877 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd3e9c-7861-423e-afad-6060767cfe80 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:21.124298 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd3e9c-7861-423e-afad-6060767cfe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:21.138065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d230456-5088-4d86-bc3a-db3e9bf7ed1d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:21.150570 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bec807-075f-45ca-a1f8-ecd8b8108bc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:21.152626 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bec807-075f-45ca-a1f8-ecd8b8108bc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:21.152956 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bec807-075f-45ca-a1f8-ecd8b8108bc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:21.153222 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bec807-075f-45ca-a1f8-ecd8b8108bc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:21.159934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-b4cd3e9c-7861-423e-afad-6060767cfe80 None None] MFA Rules not processed for user `77b43d235d0441b3b8a272d051b54ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:21.159934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b4cd3e9c-7861-423e-afad-6060767cfe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:21.184514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bec807-075f-45ca-a1f8-ecd8b8108bc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:21.191680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bec807-075f-45ca-a1f8-ecd8b8108bc8 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:21.231089 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 663/1338] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:21.287156 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 676/1339] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 31 15:09:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:09:21.336459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bec807-075f-45ca-a1f8-ecd8b8108bc8 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:21.336741 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-58bec807-075f-45ca-a1f8-ecd8b8108bc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:21.372408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bec807-075f-45ca-a1f8-ecd8b8108bc8 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:21.380518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26754a5f-5be9-4c0a-a15c-e88cd51b5bc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:21.382043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754a5f-5be9-4c0a-a15c-e88cd51b5bc7 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:21.382829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754a5f-5be9-4c0a-a15c-e88cd51b5bc7 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:21.383117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26754a5f-5be9-4c0a-a15c-e88cd51b5bc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:21.443162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26754a5f-5be9-4c0a-a15c-e88cd51b5bc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:21.445036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26754a5f-5be9-4c0a-a15c-e88cd51b5bc7 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:21.466967 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 664/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:09:22.869666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd3e9c-7861-423e-afad-6060767cfe80 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:23.072917 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26754a5f-5be9-4c0a-a15c-e88cd51b5bc7 service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:23.074881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-26754a5f-5be9-4c0a-a15c-e88cd51b5bc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:23.112128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd3e9c-7861-423e-afad-6060767cfe80 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:23.118755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bde974-cc3a-491b-96f7-1a960c881443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:23.119459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bde974-cc3a-491b-96f7-1a960c881443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:23.119733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bde974-cc3a-491b-96f7-1a960c881443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:23.120001 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bde974-cc3a-491b-96f7-1a960c881443 admin admin] PATH_INFO: `/v3/users/e858fb6285fe4039a95a5f0578663a63` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:23.121228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bde974-cc3a-491b-96f7-1a960c881443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e858fb6285fe4039a95a5f0578663a63)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:23.123350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bde974-cc3a-491b-96f7-1a960c881443 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:23.218602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26754a5f-5be9-4c0a-a15c-e88cd51b5bc7 service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:23.235386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ac92b-70f5-47d5-959e-7dfe272cfefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:23.236057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ac92b-70f5-47d5-959e-7dfe272cfefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:23.236437 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ac92b-70f5-47d5-959e-7dfe272cfefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:23.236586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ac92b-70f5-47d5-959e-7dfe272cfefc admin admin] PATH_INFO: `/v3/users/62088e8d368349bfab1b603df1aed98c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:23.238263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ac92b-70f5-47d5-959e-7dfe272cfefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=62088e8d368349bfab1b603df1aed98c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:23.239840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-3b1ac92b-70f5-47d5-959e-7dfe272cfefc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:09:23.239840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: warnings.warn(msg) Oct 31 15:09:23.239840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: Oct 31 15:09:23.241054 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ac92b-70f5-47d5-959e-7dfe272cfefc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:23.332903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-52bde974-cc3a-491b-96f7-1a960c881443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e858fb6285fe4039a95a5f0578663a63'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:23.333612 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-52bde974-cc3a-491b-96f7-1a960c881443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e858fb6285fe4039a95a5f0578663a63'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:23.370744 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-52bde974-cc3a-491b-96f7-1a960c881443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e858fb6285fe4039a95a5f0578663a63'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:23.372231 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-52bde974-cc3a-491b-96f7-1a960c881443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e858fb6285fe4039a95a5f0578663a63'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:23.570276 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-52bde974-cc3a-491b-96f7-1a960c881443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e858fb6285fe4039a95a5f0578663a63'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:23.571839 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:23.605588 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 677/1341] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:22 2022] DELETE /identity/v3/users/e858fb6285fe4039a95a5f0578663a63 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:23.612602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc82e4-a24d-4f55-a7a0-5248d1569057 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:23.612891 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc82e4-a24d-4f55-a7a0-5248d1569057 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:23.615074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc82e4-a24d-4f55-a7a0-5248d1569057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:23.666493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0fdc82e4-a24d-4f55-a7a0-5248d1569057 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:23.667757 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0fdc82e4-a24d-4f55-a7a0-5248d1569057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:23.763946 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b1ac92b-70f5-47d5-959e-7dfe272cfefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62088e8d368349bfab1b603df1aed98c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:23.764718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b1ac92b-70f5-47d5-959e-7dfe272cfefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62088e8d368349bfab1b603df1aed98c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:23.792376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b1ac92b-70f5-47d5-959e-7dfe272cfefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62088e8d368349bfab1b603df1aed98c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:23.830699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 678/1342] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:23.923358 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc82e4-a24d-4f55-a7a0-5248d1569057 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:23.924998 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0fdc82e4-a24d-4f55-a7a0-5248d1569057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:23.935379 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b1ac92b-70f5-47d5-959e-7dfe272cfefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62088e8d368349bfab1b603df1aed98c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:23.988227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b1ac92b-70f5-47d5-959e-7dfe272cfefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62088e8d368349bfab1b603df1aed98c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:24.009552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 665/1343] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:23 2022] DELETE /identity/v3/users/62088e8d368349bfab1b603df1aed98c => generated 0 bytes in 937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:24.017617 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1ba3-e7bc-4290-b4be-7e94a89c21c8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:24.020776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1ba3-e7bc-4290-b4be-7e94a89c21c8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:24.021204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c1ba3-e7bc-4290-b4be-7e94a89c21c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:24.067952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc82e4-a24d-4f55-a7a0-5248d1569057 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:24.082503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-916c1ba3-e7bc-4290-b4be-7e94a89c21c8 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:24.084021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-916c1ba3-e7bc-4290-b4be-7e94a89c21c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:24.121694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:24.165237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1480a9f-641a-4f2f-a615-b38a453f42ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:24.165952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1480a9f-641a-4f2f-a615-b38a453f42ae service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:24.166227 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1480a9f-641a-4f2f-a615-b38a453f42ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:24.166494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1480a9f-641a-4f2f-a615-b38a453f42ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:24.293645 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 666/1344] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:24.323819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1480a9f-641a-4f2f-a615-b38a453f42ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:24.325614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1480a9f-641a-4f2f-a615-b38a453f42ae service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:24.341792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 679/1345] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:09:24.571385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c1ba3-e7bc-4290-b4be-7e94a89c21c8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:24.586925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c1ba3-e7bc-4290-b4be-7e94a89c21c8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:24.600362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274c119-f9e1-4ae4-a7ff-fe1cfc49952a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:24.601470 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c119-f9e1-4ae4-a7ff-fe1cfc49952a service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:24.602036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c119-f9e1-4ae4-a7ff-fe1cfc49952a service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:24.602540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c119-f9e1-4ae4-a7ff-fe1cfc49952a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:24.626833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274c119-f9e1-4ae4-a7ff-fe1cfc49952a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:24.628579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274c119-f9e1-4ae4-a7ff-fe1cfc49952a service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:25.051463 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 667/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:25.056530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4666c-1d2a-493a-97b2-41fb07cecdff None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:25.056530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4666c-1d2a-493a-97b2-41fb07cecdff None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:25.056530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4666c-1d2a-493a-97b2-41fb07cecdff None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:25.056530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 680/1347] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 31 15:09:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:09:25.061555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6ecf5-b246-4f36-bea0-488e2ac9492f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:25.061555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6ecf5-b246-4f36-bea0-488e2ac9492f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:25.061555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6ecf5-b246-4f36-bea0-488e2ac9492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:25.061555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9ef6ecf5-b246-4f36-bea0-488e2ac9492f None None] MFA Rules not processed for user `77b43d235d0441b3b8a272d051b54ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:25.061555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9ef6ecf5-b246-4f36-bea0-488e2ac9492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:25.061555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 668/1348] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 31 15:09:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:25.062395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4666c-1d2a-493a-97b2-41fb07cecdff None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:25.064870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-10a4666c-1d2a-493a-97b2-41fb07cecdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:25.088490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4666c-1d2a-493a-97b2-41fb07cecdff None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:25.095565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9381ab5-8aba-40c4-947b-58b942f51eb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:25.100499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9381ab5-8aba-40c4-947b-58b942f51eb6 service placement] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:25.100499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9381ab5-8aba-40c4-947b-58b942f51eb6 service placement] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:25.100499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9381ab5-8aba-40c4-947b-58b942f51eb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:25.113762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9381ab5-8aba-40c4-947b-58b942f51eb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:25.115925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9381ab5-8aba-40c4-947b-58b942f51eb6 service placement] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:25.141398 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 681/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:25.253063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6ecf5-b246-4f36-bea0-488e2ac9492f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:25.255109 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9ef6ecf5-b246-4f36-bea0-488e2ac9492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:25.269797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6ecf5-b246-4f36-bea0-488e2ac9492f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:25.275011 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:25.275891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:25.276306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:25.276752 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] PATH_INFO: `/v3/users/f7e1533e050f4ae38c3ad3ad79150c05` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:25.278548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e1533e050f4ae38c3ad3ad79150c05)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:25.280879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:25.434531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:25.512325 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e1533e050f4ae38c3ad3ad79150c05'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:25.516955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e1533e050f4ae38c3ad3ad79150c05'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:25.526499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e1533e050f4ae38c3ad3ad79150c05'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:25.668297 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e1533e050f4ae38c3ad3ad79150c05'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:25.701197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e1533e050f4ae38c3ad3ad79150c05'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:25.712642 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 669/1350] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:25 2022] DELETE /identity/v3/users/f7e1533e050f4ae38c3ad3ad79150c05 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:26.518883 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9381ab5-8aba-40c4-947b-58b942f51eb6 service placement] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:26.520649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e9381ab5-8aba-40c4-947b-58b942f51eb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:26.548670 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9381ab5-8aba-40c4-947b-58b942f51eb6 service placement] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:26.668988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377f23f-bc1a-4433-9794-3c5a25975215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:26.670028 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377f23f-bc1a-4433-9794-3c5a25975215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:26.670753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377f23f-bc1a-4433-9794-3c5a25975215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:26.671220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377f23f-bc1a-4433-9794-3c5a25975215 admin admin] PATH_INFO: `/v3/projects/c11663c959be422f86b356402a5cb9bc` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:26.673379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377f23f-bc1a-4433-9794-3c5a25975215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11663c959be422f86b356402a5cb9bc)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:26.674965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: WARNING py.warnings [None req-9377f23f-bc1a-4433-9794-3c5a25975215 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 31 15:09:26.674965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: warnings.warn(msg) Oct 31 15:09:26.674965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: Oct 31 15:09:26.676769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377f23f-bc1a-4433-9794-3c5a25975215 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:26.807003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:26.810778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:26.852930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb546ee-fe8a-45de-bc6a-6bc48011073c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:26.875970 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9377f23f-bc1a-4433-9794-3c5a25975215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11663c959be422f86b356402a5cb9bc', 'request_id': 'req-9377f23f-bc1a-4433-9794-3c5a25975215'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:26.880915 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:26.975751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:26.976469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:26.976749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:26.977016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] PATH_INFO: `/v3/projects/7d5df19dd58344969a677388b7458ccf` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:26.986597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9377f23f-bc1a-4433-9794-3c5a25975215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11663c959be422f86b356402a5cb9bc', 'request_id': 'req-9377f23f-bc1a-4433-9794-3c5a25975215'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:26.995809 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5df19dd58344969a677388b7458ccf)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:27.002380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:27.019480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9377f23f-bc1a-4433-9794-3c5a25975215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11663c959be422f86b356402a5cb9bc', 'request_id': 'req-9377f23f-bc1a-4433-9794-3c5a25975215'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:27.050478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9377f23f-bc1a-4433-9794-3c5a25975215 admin admin] The token cache is being invalidate because project c11663c959be422f86b356402a5cb9bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:27.051345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9377f23f-bc1a-4433-9794-3c5a25975215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:27.052289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9377f23f-bc1a-4433-9794-3c5a25975215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:27.054495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 682/1351] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:26 2022] DELETE /identity/v3/projects/c11663c959be422f86b356402a5cb9bc => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:27.060386 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94b76-0779-49e4-9a89-b3baad2d2873 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:27.061602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94b76-0779-49e4-9a89-b3baad2d2873 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:27.062142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f94b76-0779-49e4-9a89-b3baad2d2873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:27.098364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-02f94b76-0779-49e4-9a89-b3baad2d2873 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:27.100242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-02f94b76-0779-49e4-9a89-b3baad2d2873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:27.118098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 683/1352] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:27.127274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269caa9-e0bc-4dc8-8cba-97f3f18dce5b None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:27.127885 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269caa9-e0bc-4dc8-8cba-97f3f18dce5b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:27.135758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269caa9-e0bc-4dc8-8cba-97f3f18dce5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:27.175778 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e269caa9-e0bc-4dc8-8cba-97f3f18dce5b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:27.179295 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e269caa9-e0bc-4dc8-8cba-97f3f18dce5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:27.210690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5df19dd58344969a677388b7458ccf', 'request_id': 'req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:27.296016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5df19dd58344969a677388b7458ccf', 'request_id': 'req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:27.309240 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5df19dd58344969a677388b7458ccf', 'request_id': 'req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:27.329484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 684/1353] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:27.334068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269caa9-e0bc-4dc8-8cba-97f3f18dce5b None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:27.340332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] The token cache is being invalidate because project 7d5df19dd58344969a677388b7458ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:27.340666 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:27.344215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:27.355033 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 670/1354] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:26 2022] DELETE /identity/v3/projects/7d5df19dd58344969a677388b7458ccf => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:09:27.356511 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:27.358619 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:27.361113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269caa9-e0bc-4dc8-8cba-97f3f18dce5b None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:27.380487 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78067998-6aea-46a9-bf68-6fcdab23c004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:27.384406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067998-6aea-46a9-bf68-6fcdab23c004 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:27.384406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067998-6aea-46a9-bf68-6fcdab23c004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:27.384406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067998-6aea-46a9-bf68-6fcdab23c004 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:27.384406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78067998-6aea-46a9-bf68-6fcdab23c004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:27.384406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78067998-6aea-46a9-bf68-6fcdab23c004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:27.387176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78067998-6aea-46a9-bf68-6fcdab23c004 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:27.393718 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:27.400784 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf798bc-be34-4eaf-a82c-2eadc22d9fa7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:27.410851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68e6fd-c240-44d1-898b-b2b037337296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:27.412935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68e6fd-c240-44d1-898b-b2b037337296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:27.412935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68e6fd-c240-44d1-898b-b2b037337296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:27.412935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68e6fd-c240-44d1-898b-b2b037337296 admin admin] PATH_INFO: `/v3/users/82ae53452f9c4a97b23daf00e956b115` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:27.413765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68e6fd-c240-44d1-898b-b2b037337296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ae53452f9c4a97b23daf00e956b115)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:27.417953 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68e6fd-c240-44d1-898b-b2b037337296 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:27.430775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 685/1355] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:09:27.431879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78067998-6aea-46a9-bf68-6fcdab23c004 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:27.433772 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-78067998-6aea-46a9-bf68-6fcdab23c004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:27.460695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78067998-6aea-46a9-bf68-6fcdab23c004 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:27.475874 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebef6bf-07f7-4490-8a53-16bf6180ea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:27.476772 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebef6bf-07f7-4490-8a53-16bf6180ea77 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:27.477834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebef6bf-07f7-4490-8a53-16bf6180ea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:27.479398 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebef6bf-07f7-4490-8a53-16bf6180ea77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:27.481097 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebef6bf-07f7-4490-8a53-16bf6180ea77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:27.488211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebef6bf-07f7-4490-8a53-16bf6180ea77 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:27.593042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 686/1356] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:27 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:27.598303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebef6bf-07f7-4490-8a53-16bf6180ea77 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:27.686854 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b68e6fd-c240-44d1-898b-b2b037337296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ae53452f9c4a97b23daf00e956b115'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:27.689663 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b68e6fd-c240-44d1-898b-b2b037337296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ae53452f9c4a97b23daf00e956b115'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:27.710872 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b68e6fd-c240-44d1-898b-b2b037337296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ae53452f9c4a97b23daf00e956b115'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:27.816639 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebef6bf-07f7-4490-8a53-16bf6180ea77 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:27.829903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e1caf-682a-425b-b00a-d12735e2b522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:27.830623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e1caf-682a-425b-b00a-d12735e2b522 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:27.831019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e1caf-682a-425b-b00a-d12735e2b522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:27.833804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e1caf-682a-425b-b00a-d12735e2b522 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:27.835227 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e1caf-682a-425b-b00a-d12735e2b522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:27.838881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b68e6fd-c240-44d1-898b-b2b037337296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ae53452f9c4a97b23daf00e956b115'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:27.841588 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e1caf-682a-425b-b00a-d12735e2b522 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:27.860320 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b68e6fd-c240-44d1-898b-b2b037337296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ae53452f9c4a97b23daf00e956b115'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:27.872194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 671/1357] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:27 2022] DELETE /identity/v3/users/82ae53452f9c4a97b23daf00e956b115 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:27.873776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a9972-782f-47d5-8d87-b21e1dc63db9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:27.875764 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a9972-782f-47d5-8d87-b21e1dc63db9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:27.875764 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a9972-782f-47d5-8d87-b21e1dc63db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:27.916517 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6a0a9972-782f-47d5-8d87-b21e1dc63db9 None None] MFA Rules not processed for user `093519cbc8564b859c01a3a3ab1aae3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:27.918636 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6a0a9972-782f-47d5-8d87-b21e1dc63db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:27.975769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 687/1358] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:27 2022] POST /identity/v3/users => generated 290 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:27.976768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e1caf-682a-425b-b00a-d12735e2b522 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:27.980110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-539e1caf-682a-425b-b00a-d12735e2b522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:28.014311 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e1caf-682a-425b-b00a-d12735e2b522 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:28.042824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 672/1359] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:28.044785 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51e29d-5788-44c2-9284-171525488862 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:28.045253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51e29d-5788-44c2-9284-171525488862 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:28.045708 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51e29d-5788-44c2-9284-171525488862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:28.097629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6e51e29d-5788-44c2-9284-171525488862 None None] MFA Rules not processed for user `5d83b424ffbc4a879b490d9ac6e84ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:28.099198 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6e51e29d-5788-44c2-9284-171525488862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:28.155920 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:28.157481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:28.157865 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:28.158253 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] PATH_INFO: `/v3/projects/fa951e0dedc64a38b4dd516e5b614a1a` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:28.159737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa951e0dedc64a38b4dd516e5b614a1a)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:28.163175 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:28.218613 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 673/1360] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:28.223690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51e29d-5788-44c2-9284-171525488862 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:28.226391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6e51e29d-5788-44c2-9284-171525488862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:28.267288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51e29d-5788-44c2-9284-171525488862 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:28.283555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab607d-9b6c-4b1e-8370-252b14396f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:28.284387 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab607d-9b6c-4b1e-8370-252b14396f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:28.284749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab607d-9b6c-4b1e-8370-252b14396f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:28.284959 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab607d-9b6c-4b1e-8370-252b14396f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:28.285986 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab607d-9b6c-4b1e-8370-252b14396f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:28.287331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab607d-9b6c-4b1e-8370-252b14396f5e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:28.305379 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 674/1361] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:28.306193 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab607d-9b6c-4b1e-8370-252b14396f5e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:28.309552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aeab607d-9b6c-4b1e-8370-252b14396f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:28.392541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa951e0dedc64a38b4dd516e5b614a1a', 'request_id': 'req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:28.458500 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab607d-9b6c-4b1e-8370-252b14396f5e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:28.562599 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a29e66-80b9-4995-b0ab-29aa8f6de652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:28.564843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a29e66-80b9-4995-b0ab-29aa8f6de652 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:28.565160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a29e66-80b9-4995-b0ab-29aa8f6de652 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:28.565528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a29e66-80b9-4995-b0ab-29aa8f6de652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:28.566714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa951e0dedc64a38b4dd516e5b614a1a', 'request_id': 'req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:28.594919 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa951e0dedc64a38b4dd516e5b614a1a', 'request_id': 'req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:28.647578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] The token cache is being invalidate because project fa951e0dedc64a38b4dd516e5b614a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:28.648140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:28.649662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:28.653940 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 688/1362] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:27 2022] DELETE /identity/v3/projects/fa951e0dedc64a38b4dd516e5b614a1a => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:28.655477 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:28.659804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:28.694368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effd05e-1e01-44cf-8b50-4d4451cd7f6f admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:28.704843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a29e66-80b9-4995-b0ab-29aa8f6de652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:28.708246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a29e66-80b9-4995-b0ab-29aa8f6de652 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:28.714048 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94d97c-87d3-4e22-b63e-23232cf8cd80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:28.716570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d97c-87d3-4e22-b63e-23232cf8cd80 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:28.717068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d97c-87d3-4e22-b63e-23232cf8cd80 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:28.717546 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d97c-87d3-4e22-b63e-23232cf8cd80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:28.719986 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ac94d97c-87d3-4e22-b63e-23232cf8cd80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:28.741613 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 675/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:28.743290 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a29e66-80b9-4995-b0ab-29aa8f6de652 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:28.851452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:28.903758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a29e66-80b9-4995-b0ab-29aa8f6de652 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:28.920060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1fcce-5899-4b9f-bd6c-650da36bad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:28.920700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1fcce-5899-4b9f-bd6c-650da36bad70 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:28.920981 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1fcce-5899-4b9f-bd6c-650da36bad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:28.921257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1fcce-5899-4b9f-bd6c-650da36bad70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:28.922102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1fcce-5899-4b9f-bd6c-650da36bad70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:28.923888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1fcce-5899-4b9f-bd6c-650da36bad70 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:28.957550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 676/1364] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:28.960111 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1fcce-5899-4b9f-bd6c-650da36bad70 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:28.962581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94d97c-87d3-4e22-b63e-23232cf8cd80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:28.965740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94d97c-87d3-4e22-b63e-23232cf8cd80 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:28.966548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-98a1fcce-5899-4b9f-bd6c-650da36bad70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:28.998142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 689/1365] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:28.999415 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94d97c-87d3-4e22-b63e-23232cf8cd80 service nova] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:29.001691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ac94d97c-87d3-4e22-b63e-23232cf8cd80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:29.016996 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1fcce-5899-4b9f-bd6c-650da36bad70 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:29.025872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94d97c-87d3-4e22-b63e-23232cf8cd80 service nova] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:29.030231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d68a1-75bd-459a-92ac-c7a0d3453d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:29.031064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d68a1-75bd-459a-92ac-c7a0d3453d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:29.031438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d68a1-75bd-459a-92ac-c7a0d3453d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:29.031986 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d68a1-75bd-459a-92ac-c7a0d3453d06 admin admin] PATH_INFO: `/v3/users/0f9ae09bcc914621b8598b697b9df3ee` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:29.033711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:29.033853 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d68a1-75bd-459a-92ac-c7a0d3453d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9ae09bcc914621b8598b697b9df3ee)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:29.034822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:29.035342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:29.035799 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] PATH_INFO: `/v3/projects/882368fb5eb2463f92746681234fd552` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:29.037695 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d68a1-75bd-459a-92ac-c7a0d3453d06 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:29.045603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=882368fb5eb2463f92746681234fd552)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:29.045603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:29.214334 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:29.341389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882368fb5eb2463f92746681234fd552', 'request_id': 'req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:29.345143 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f68d68a1-75bd-459a-92ac-c7a0d3453d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9ae09bcc914621b8598b697b9df3ee'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:29.347806 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f68d68a1-75bd-459a-92ac-c7a0d3453d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9ae09bcc914621b8598b697b9df3ee'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:29.392419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f68d68a1-75bd-459a-92ac-c7a0d3453d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9ae09bcc914621b8598b697b9df3ee'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:29.451968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882368fb5eb2463f92746681234fd552', 'request_id': 'req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:29.465567 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882368fb5eb2463f92746681234fd552', 'request_id': 'req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:29.495750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] The token cache is being invalidate because project 882368fb5eb2463f92746681234fd552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:29.496119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:29.498367 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:29.500184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 690/1366] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:28 2022] DELETE /identity/v3/projects/882368fb5eb2463f92746681234fd552 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:29.504080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:29.504080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:29.556424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f68d68a1-75bd-459a-92ac-c7a0d3453d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9ae09bcc914621b8598b697b9df3ee'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:29.596740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f68d68a1-75bd-459a-92ac-c7a0d3453d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9ae09bcc914621b8598b697b9df3ee'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:29.617145 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 677/1367] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:28 2022] DELETE /identity/v3/users/0f9ae09bcc914621b8598b697b9df3ee => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:29.623822 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b13568-b6d1-4d97-801e-ce8cd4f4a716 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:29.624133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b13568-b6d1-4d97-801e-ce8cd4f4a716 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:29.624406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b13568-b6d1-4d97-801e-ce8cd4f4a716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:29.722609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-20b13568-b6d1-4d97-801e-ce8cd4f4a716 None None] MFA Rules not processed for user `4adb546848a744b3a3ed4d77bc02c0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:29.727229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79da20-ba25-4b57-9a3b-80d0ef83d1ff admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:29.727638 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-20b13568-b6d1-4d97-801e-ce8cd4f4a716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:29.866098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718464a7-1014-4456-ac14-3968a7ad1e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:29.866969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718464a7-1014-4456-ac14-3968a7ad1e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:29.867386 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718464a7-1014-4456-ac14-3968a7ad1e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:29.867781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718464a7-1014-4456-ac14-3968a7ad1e3e admin admin] PATH_INFO: `/v3/projects/45d98ca6c4ab43c7bde6a76dbacd487f/users/11f0fc8116f04e5e89c04e678a0383de/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:29.888874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 678/1368] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:29.891594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34d1af-670a-4ec3-acc5-dd4ada1c884a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:29.899507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34d1af-670a-4ec3-acc5-dd4ada1c884a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:29.900508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34d1af-670a-4ec3-acc5-dd4ada1c884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:29.906489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718464a7-1014-4456-ac14-3968a7ad1e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d98ca6c4ab43c7bde6a76dbacd487f, user_id=11f0fc8116f04e5e89c04e678a0383de, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:29.911101 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718464a7-1014-4456-ac14-3968a7ad1e3e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:29.937598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cd34d1af-670a-4ec3-acc5-dd4ada1c884a None None] MFA Rules not processed for user `e5109f4de7554ecf9840ff6922eb05fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:29.939101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cd34d1af-670a-4ec3-acc5-dd4ada1c884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:30.013627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 691/1369] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:29 2022] PUT /identity/v3/projects/45d98ca6c4ab43c7bde6a76dbacd487f/users/11f0fc8116f04e5e89c04e678a0383de/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:30.027173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3669c-ccf1-427f-91aa-6d3f8dd3a8f9 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:30.031683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3669c-ccf1-427f-91aa-6d3f8dd3a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:30.031683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3669c-ccf1-427f-91aa-6d3f8dd3a8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:30.069680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 679/1370] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:30.069680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c706b-40ae-44a7-bf4c-1acdc1201cfb None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:30.069680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c706b-40ae-44a7-bf4c-1acdc1201cfb None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:30.069680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c706b-40ae-44a7-bf4c-1acdc1201cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:30.098610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-6fc3669c-ccf1-427f-91aa-6d3f8dd3a8f9 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:30.100644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6fc3669c-ccf1-427f-91aa-6d3f8dd3a8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:30.150876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-070c706b-40ae-44a7-bf4c-1acdc1201cfb None None] MFA Rules not processed for user `7f915ab5fe6b4ec1a82b7cc7e62427b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:30.156343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-070c706b-40ae-44a7-bf4c-1acdc1201cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:30.278097 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 692/1371] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:30.283936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99245bd-da29-4efe-b80f-3be4e15498a0 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:30.283936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99245bd-da29-4efe-b80f-3be4e15498a0 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:30.283936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99245bd-da29-4efe-b80f-3be4e15498a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:30.354009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-b99245bd-da29-4efe-b80f-3be4e15498a0 None None] MFA Rules not processed for user `4adb546848a744b3a3ed4d77bc02c0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:30.356059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b99245bd-da29-4efe-b80f-3be4e15498a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:30.371012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 680/1372] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:30.372707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a789f-e6d9-4dd2-9d09-76247deea4c2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:30.373214 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a789f-e6d9-4dd2-9d09-76247deea4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:30.373641 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a789f-e6d9-4dd2-9d09-76247deea4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:30.440988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-987a789f-e6d9-4dd2-9d09-76247deea4c2 None None] MFA Rules not processed for user `11f0fc8116f04e5e89c04e678a0383de`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:30.442563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-987a789f-e6d9-4dd2-9d09-76247deea4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:30.503185 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 693/1373] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:30.504796 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6038e90-4df2-4821-a827-fe99d95d9a58 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:30.505133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6038e90-4df2-4821-a827-fe99d95d9a58 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:30.505432 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6038e90-4df2-4821-a827-fe99d95d9a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:30.543648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-c6038e90-4df2-4821-a827-fe99d95d9a58 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:30.544896 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c6038e90-4df2-4821-a827-fe99d95d9a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:30.576738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 694/1374] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:30.576738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6038e90-4df2-4821-a827-fe99d95d9a58 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:30.580831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c6038e90-4df2-4821-a827-fe99d95d9a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:30.605529 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6038e90-4df2-4821-a827-fe99d95d9a58 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:30.618400 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:30.619051 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:30.619324 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:30.620009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] PATH_INFO: `/v3/projects/6c86c2342e3a4227bdb64236080872a9` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:30.623047 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c86c2342e3a4227bdb64236080872a9)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:30.629214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:30.640167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 681/1375] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:30.641323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2266-9adc-4989-adce-59dd8f7db96c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:30.641323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2266-9adc-4989-adce-59dd8f7db96c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:30.641575 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2266-9adc-4989-adce-59dd8f7db96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:30.682191 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ebdd2266-9adc-4989-adce-59dd8f7db96c None None] MFA Rules not processed for user `7f915ab5fe6b4ec1a82b7cc7e62427b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:30.683974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ebdd2266-9adc-4989-adce-59dd8f7db96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:30.699134 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 682/1376] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:30.699134 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2266-9adc-4989-adce-59dd8f7db96c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:30.702992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ebdd2266-9adc-4989-adce-59dd8f7db96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:30.796245 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c86c2342e3a4227bdb64236080872a9', 'request_id': 'req-e421c5c5-176e-4b42-b526-b91c46cd9ef1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:30.856520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2266-9adc-4989-adce-59dd8f7db96c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:30.895977 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c86c2342e3a4227bdb64236080872a9', 'request_id': 'req-e421c5c5-176e-4b42-b526-b91c46cd9ef1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:30.897803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:30.907059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c86c2342e3a4227bdb64236080872a9', 'request_id': 'req-e421c5c5-176e-4b42-b526-b91c46cd9ef1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:30.928850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] The token cache is being invalidate because project 6c86c2342e3a4227bdb64236080872a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:30.929593 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:30.931111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:30.933028 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 695/1377] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:30 2022] DELETE /identity/v3/projects/6c86c2342e3a4227bdb64236080872a9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:30.938065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:30.940972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:31.016213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da658e2-1c94-4222-a4ce-c3ecd94d1912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:31.016940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da658e2-1c94-4222-a4ce-c3ecd94d1912 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.017308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da658e2-1c94-4222-a4ce-c3ecd94d1912 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.017658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da658e2-1c94-4222-a4ce-c3ecd94d1912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.020450 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7da658e2-1c94-4222-a4ce-c3ecd94d1912 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:31.093102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421c5c5-176e-4b42-b526-b91c46cd9ef1 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:31.102545 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bfddb-3a65-4c8b-a205-5d679b3efb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:31.103691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bfddb-3a65-4c8b-a205-5d679b3efb75 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.103971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bfddb-3a65-4c8b-a205-5d679b3efb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.105046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bfddb-3a65-4c8b-a205-5d679b3efb75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.106680 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bfddb-3a65-4c8b-a205-5d679b3efb75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:31.107131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bfddb-3a65-4c8b-a205-5d679b3efb75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:31.110650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bfddb-3a65-4c8b-a205-5d679b3efb75 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:31.142291 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 696/1378] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:31.143342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bfddb-3a65-4c8b-a205-5d679b3efb75 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:31.145768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b91bfddb-3a65-4c8b-a205-5d679b3efb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:31.166474 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bfddb-3a65-4c8b-a205-5d679b3efb75 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:31.168142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da658e2-1c94-4222-a4ce-c3ecd94d1912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:31.170073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da658e2-1c94-4222-a4ce-c3ecd94d1912 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:31.177151 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9ac52-bd0f-437a-9012-d8a21587d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:31.181506 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9ac52-bd0f-437a-9012-d8a21587d91e admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.181506 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9ac52-bd0f-437a-9012-d8a21587d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.181832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9ac52-bd0f-437a-9012-d8a21587d91e admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.182634 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9ac52-bd0f-437a-9012-d8a21587d91e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:31.188632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9ac52-bd0f-437a-9012-d8a21587d91e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:31.193829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 683/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:31.195313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa346b2-78e5-4133-9bab-d356955ebdab None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.197672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa346b2-78e5-4133-9bab-d356955ebdab None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.198065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa346b2-78e5-4133-9bab-d356955ebdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.248161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7fa346b2-78e5-4133-9bab-d356955ebdab None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:31.253658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7fa346b2-78e5-4133-9bab-d356955ebdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:31.279349 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 684/1380] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:31.279349 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa346b2-78e5-4133-9bab-d356955ebdab None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:31.297351 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa346b2-78e5-4133-9bab-d356955ebdab None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:31.314113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e14afe-3b93-432c-9b21-986cd13521f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:31.315041 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e14afe-3b93-432c-9b21-986cd13521f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.315491 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e14afe-3b93-432c-9b21-986cd13521f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.315923 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e14afe-3b93-432c-9b21-986cd13521f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.316781 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e14afe-3b93-432c-9b21-986cd13521f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:31.318837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e14afe-3b93-432c-9b21-986cd13521f3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:31.384780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 697/1381] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:31 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:31.387777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e11a5-47d5-42e9-bd19-8f30564b6cfa None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.389762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e11a5-47d5-42e9-bd19-8f30564b6cfa None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.390960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e11a5-47d5-42e9-bd19-8f30564b6cfa None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.407085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:31.410707 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 698/1382] 10.222.0.45 () {54 vars in 912 bytes} [Mon Oct 31 15:09:31 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:09:31.415606 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baca49-2204-4e53-a640-01e3005a940c None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.415891 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baca49-2204-4e53-a640-01e3005a940c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.416153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baca49-2204-4e53-a640-01e3005a940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.470168 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f3baca49-2204-4e53-a640-01e3005a940c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:31.472451 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f3baca49-2204-4e53-a640-01e3005a940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:31.502905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 685/1383] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:31 2022] POST /identity/v3/projects => generated 363 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:31.504811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e14afe-3b93-432c-9b21-986cd13521f3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:31.558886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:31.616226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 699/1384] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:31.617701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2d3ea-31be-46cd-b3b7-9c749254943e None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.617980 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2d3ea-31be-46cd-b3b7-9c749254943e None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.618246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2d3ea-31be-46cd-b3b7-9c749254943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.639098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e14afe-3b93-432c-9b21-986cd13521f3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:31.658220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b7304-aa77-491c-b81c-b796a0318cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:31.659219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b7304-aa77-491c-b81c-b796a0318cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.659697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b7304-aa77-491c-b81c-b796a0318cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.660640 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b7304-aa77-491c-b81c-b796a0318cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.661608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b7304-aa77-491c-b81c-b796a0318cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:31.666672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b7304-aa77-491c-b81c-b796a0318cb2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:31.720152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-b7b2d3ea-31be-46cd-b3b7-9c749254943e None None] MFA Rules not processed for user `93815827ae97419abf6fa45fbab185f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:31.721463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b7b2d3ea-31be-46cd-b3b7-9c749254943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:31.790704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 686/1385] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:31 2022] POST /identity/v3/users => generated 298 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:31.794875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b7304-aa77-491c-b81c-b796a0318cb2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:31.814121 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b7304-aa77-491c-b81c-b796a0318cb2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:31.824452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dacf2e-9706-46db-a794-0d8aa92dec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:31.825134 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dacf2e-9706-46db-a794-0d8aa92dec37 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.826622 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dacf2e-9706-46db-a794-0d8aa92dec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.827489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dacf2e-9706-46db-a794-0d8aa92dec37 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.827743 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dacf2e-9706-46db-a794-0d8aa92dec37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:31.830740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dacf2e-9706-46db-a794-0d8aa92dec37 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:31.839511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 700/1386] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:09:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:31.840484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2d3ea-31be-46cd-b3b7-9c749254943e None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:31.862756 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2d3ea-31be-46cd-b3b7-9c749254943e None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:31.869837 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99308fa-c3b4-4944-8cea-f238cb10e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:31.870782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99308fa-c3b4-4944-8cea-f238cb10e742 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.871354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99308fa-c3b4-4944-8cea-f238cb10e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.871695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99308fa-c3b4-4944-8cea-f238cb10e742 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.872808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99308fa-c3b4-4944-8cea-f238cb10e742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:31.873116 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99308fa-c3b4-4944-8cea-f238cb10e742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:31.875180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99308fa-c3b4-4944-8cea-f238cb10e742 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:31.894691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 701/1387] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:31.896291 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99308fa-c3b4-4944-8cea-f238cb10e742 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:31.911865 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99308fa-c3b4-4944-8cea-f238cb10e742 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:31.916610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ade9a-dbd5-4172-b93c-fb1453aa4bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:31.917424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ade9a-dbd5-4172-b93c-fb1453aa4bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.917759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ade9a-dbd5-4172-b93c-fb1453aa4bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.918030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ade9a-dbd5-4172-b93c-fb1453aa4bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.918676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ade9a-dbd5-4172-b93c-fb1453aa4bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:31.920407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ade9a-dbd5-4172-b93c-fb1453aa4bc3 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:31.936350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 702/1388] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:31.939430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04749c-58f8-41b8-921c-1129e3b9c118 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.939720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04749c-58f8-41b8-921c-1129e3b9c118 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.939987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04749c-58f8-41b8-921c-1129e3b9c118 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.941838 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 703/1389] 10.222.0.45 () {54 vars in 912 bytes} [Mon Oct 31 15:09:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:09:31.942130 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 687/1390] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:31 2022] POST /identity/v3/users => generated 282 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:31.943248 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dacf2e-9706-46db-a794-0d8aa92dec37 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:31.949717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04749c-58f8-41b8-921c-1129e3b9c118 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:31.951611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-dd04749c-58f8-41b8-921c-1129e3b9c118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:31.957698 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dacf2e-9706-46db-a794-0d8aa92dec37 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:31.963746 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad4d0f-87c2-4d83-9bf4-122b23338561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:31.970157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad4d0f-87c2-4d83-9bf4-122b23338561 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.970157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad4d0f-87c2-4d83-9bf4-122b23338561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.970157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad4d0f-87c2-4d83-9bf4-122b23338561 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.970157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad4d0f-87c2-4d83-9bf4-122b23338561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:31.970663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04749c-58f8-41b8-921c-1129e3b9c118 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:31.975116 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41ff6a-a992-4cc5-b2c1-4445ef4ed4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:31.976402 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41ff6a-a992-4cc5-b2c1-4445ef4ed4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:31.976649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41ff6a-a992-4cc5-b2c1-4445ef4ed4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:31.976930 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41ff6a-a992-4cc5-b2c1-4445ef4ed4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:31.989506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad4d0f-87c2-4d83-9bf4-122b23338561 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:31.991275 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41ff6a-a992-4cc5-b2c1-4445ef4ed4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:31.992780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41ff6a-a992-4cc5-b2c1-4445ef4ed4f1 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:32.021150 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 704/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:32.022983 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41ff6a-a992-4cc5-b2c1-4445ef4ed4f1 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:32.040018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41ff6a-a992-4cc5-b2c1-4445ef4ed4f1 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:32.047923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2d9f4-951e-4bbd-ab83-c44372ed4bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:32.048902 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2d9f4-951e-4bbd-ab83-c44372ed4bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:32.049379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2d9f4-951e-4bbd-ab83-c44372ed4bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:32.049815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2d9f4-951e-4bbd-ab83-c44372ed4bb1 admin admin] PATH_INFO: `/v3/projects/6a491a4c16c5469682b11fd83983951f/users/b1fe13f7b0284e75b847c3761063d0b3/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:32.087910 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2d9f4-951e-4bbd-ab83-c44372ed4bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a491a4c16c5469682b11fd83983951f, user_id=b1fe13f7b0284e75b847c3761063d0b3, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:32.090882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2d9f4-951e-4bbd-ab83-c44372ed4bb1 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:32.157472 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 688/1392] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:31 2022] POST /identity/v3/projects => generated 387 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:32.159311 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad4d0f-87c2-4d83-9bf4-122b23338561 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:32.205584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 705/1393] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:32 2022] PUT /identity/v3/projects/6a491a4c16c5469682b11fd83983951f/users/b1fe13f7b0284e75b847c3761063d0b3/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:32.207260 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dd1a2-6288-41d7-ad09-307b09a29482 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:32.207929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dd1a2-6288-41d7-ad09-307b09a29482 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:32.209435 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dd1a2-6288-41d7-ad09-307b09a29482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:32.281638 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-643dd1a2-6288-41d7-ad09-307b09a29482 None None] MFA Rules not processed for user `93815827ae97419abf6fa45fbab185f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:32.287472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-643dd1a2-6288-41d7-ad09-307b09a29482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:32.345508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad4d0f-87c2-4d83-9bf4-122b23338561 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:32.430900 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 706/1394] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:09:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:32.432599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dd1a2-6288-41d7-ad09-307b09a29482 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:32.536791 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863b15-c149-4e51-bafe-6c1c4330b555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:32.545413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863b15-c149-4e51-bafe-6c1c4330b555 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:32.545413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863b15-c149-4e51-bafe-6c1c4330b555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:32.545413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863b15-c149-4e51-bafe-6c1c4330b555 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:32.545413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6863b15-c149-4e51-bafe-6c1c4330b555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:32.545413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6863b15-c149-4e51-bafe-6c1c4330b555 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:32.565436 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 689/1395] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:32.567315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863b15-c149-4e51-bafe-6c1c4330b555 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:32.584673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863b15-c149-4e51-bafe-6c1c4330b555 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:32.600234 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb80c3-ac6e-45d0-a7d4-16acf5eaf7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:32.600952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb80c3-ac6e-45d0-a7d4-16acf5eaf7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:32.601280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb80c3-ac6e-45d0-a7d4-16acf5eaf7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:32.601639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb80c3-ac6e-45d0-a7d4-16acf5eaf7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:32.602288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb80c3-ac6e-45d0-a7d4-16acf5eaf7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:32.606814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dd1a2-6288-41d7-ad09-307b09a29482 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:32.608319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb80c3-ac6e-45d0-a7d4-16acf5eaf7d6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:32.617683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a19a83-4747-4336-8ca6-32fc2dc06467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:32.618340 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a19a83-4747-4336-8ca6-32fc2dc06467 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:32.618650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a19a83-4747-4336-8ca6-32fc2dc06467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:32.618886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a19a83-4747-4336-8ca6-32fc2dc06467 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:32.619741 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a19a83-4747-4336-8ca6-32fc2dc06467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:32.621511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a19a83-4747-4336-8ca6-32fc2dc06467 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:32.643357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 690/1396] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:32.647025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb80c3-ac6e-45d0-a7d4-16acf5eaf7d6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:32.662849 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb80c3-ac6e-45d0-a7d4-16acf5eaf7d6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:32.668699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6ef87-8406-4312-b73e-13b53cd8db73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:32.669395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6ef87-8406-4312-b73e-13b53cd8db73 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:32.669673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6ef87-8406-4312-b73e-13b53cd8db73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:32.669940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6ef87-8406-4312-b73e-13b53cd8db73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:32.681609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6ef87-8406-4312-b73e-13b53cd8db73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:32.690040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6ef87-8406-4312-b73e-13b53cd8db73 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:32.709672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 691/1397] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:32.713676 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6ef87-8406-4312-b73e-13b53cd8db73 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:32.743543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 707/1398] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:32 2022] POST /identity/v3/users => generated 294 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:32.744396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a19a83-4747-4336-8ca6-32fc2dc06467 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:32.759911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6ef87-8406-4312-b73e-13b53cd8db73 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:32.771691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a19a83-4747-4336-8ca6-32fc2dc06467 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:32.778248 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb757ff5-0128-4a16-ac7f-8485618f23fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:32.778895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb757ff5-0128-4a16-ac7f-8485618f23fa admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:32.779170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb757ff5-0128-4a16-ac7f-8485618f23fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:32.779439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb757ff5-0128-4a16-ac7f-8485618f23fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:32.780082 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb757ff5-0128-4a16-ac7f-8485618f23fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:32.782328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb757ff5-0128-4a16-ac7f-8485618f23fa admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:32.791639 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16541e5f-fd64-4f89-a038-33b27db75514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:32.792348 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16541e5f-fd64-4f89-a038-33b27db75514 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:32.792631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16541e5f-fd64-4f89-a038-33b27db75514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:32.792911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16541e5f-fd64-4f89-a038-33b27db75514 admin admin] PATH_INFO: `/v3/projects/6a491a4c16c5469682b11fd83983951f/users/b1fe13f7b0284e75b847c3761063d0b3/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:32.806237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16541e5f-fd64-4f89-a038-33b27db75514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a491a4c16c5469682b11fd83983951f, user_id=b1fe13f7b0284e75b847c3761063d0b3, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:32.808959 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16541e5f-fd64-4f89-a038-33b27db75514 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:32.812755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 692/1399] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:32.813758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb757ff5-0128-4a16-ac7f-8485618f23fa admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:32.852666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 708/1400] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:32 2022] PUT /identity/v3/projects/6a491a4c16c5469682b11fd83983951f/users/b1fe13f7b0284e75b847c3761063d0b3/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:32.852666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16541e5f-fd64-4f89-a038-33b27db75514 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:32.853489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb757ff5-0128-4a16-ac7f-8485618f23fa admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:33.019959 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16541e5f-fd64-4f89-a038-33b27db75514 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:33.042618 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a3c4d-c16e-498a-bde5-a4415f933cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:33.043657 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a3c4d-c16e-498a-bde5-a4415f933cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:33.043657 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a3c4d-c16e-498a-bde5-a4415f933cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:33.043844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a3c4d-c16e-498a-bde5-a4415f933cb1 admin admin] PATH_INFO: `/v3/projects/fb21460eda92439d83c7c10dee657902/users/4140f67775ef4de898e0d973bece67a4/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:33.050626 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910e7d3-524e-445f-baca-e3a8454f0da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:33.051599 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910e7d3-524e-445f-baca-e3a8454f0da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:33.051791 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910e7d3-524e-445f-baca-e3a8454f0da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:33.052035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910e7d3-524e-445f-baca-e3a8454f0da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:33.052685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910e7d3-524e-445f-baca-e3a8454f0da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:33.057690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910e7d3-524e-445f-baca-e3a8454f0da4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:33.082657 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a3c4d-c16e-498a-bde5-a4415f933cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb21460eda92439d83c7c10dee657902, user_id=4140f67775ef4de898e0d973bece67a4, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:33.085548 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a3c4d-c16e-498a-bde5-a4415f933cb1 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:33.094875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 693/1401] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:33.097239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a093d-48a2-4ac6-9f6b-f33fa40687b1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:33.097688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a093d-48a2-4ac6-9f6b-f33fa40687b1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:33.098130 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a093d-48a2-4ac6-9f6b-f33fa40687b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:33.105326 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:33.147138 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-655a093d-48a2-4ac6-9f6b-f33fa40687b1 None None] MFA Rules not processed for user `b1fe13f7b0284e75b847c3761063d0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:33.148721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-655a093d-48a2-4ac6-9f6b-f33fa40687b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:33.176905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 709/1402] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:32 2022] PUT /identity/v3/projects/fb21460eda92439d83c7c10dee657902/users/4140f67775ef4de898e0d973bece67a4/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:33.188721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a3c4d-c16e-498a-bde5-a4415f933cb1 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:33.194811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9d6a3c4d-c16e-498a-bde5-a4415f933cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:33.336028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 694/1403] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:33.337162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a093d-48a2-4ac6-9f6b-f33fa40687b1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:33.364273 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a093d-48a2-4ac6-9f6b-f33fa40687b1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:33.457259 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a3c4d-c16e-498a-bde5-a4415f933cb1 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:33.484247 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7660c5c-00c3-4ac1-a9d3-e45bbcb02936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:33.485456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7660c5c-00c3-4ac1-a9d3-e45bbcb02936 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:33.485847 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7660c5c-00c3-4ac1-a9d3-e45bbcb02936 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:33.486225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7660c5c-00c3-4ac1-a9d3-e45bbcb02936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:33.492651 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f7660c5c-00c3-4ac1-a9d3-e45bbcb02936 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:33.541747 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38db9e0-8cee-4663-a47b-9021ff22ab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:33.541747 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38db9e0-8cee-4663-a47b-9021ff22ab81 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:33.541747 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38db9e0-8cee-4663-a47b-9021ff22ab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:33.541747 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38db9e0-8cee-4663-a47b-9021ff22ab81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:33.542037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38db9e0-8cee-4663-a47b-9021ff22ab81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:33.543919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38db9e0-8cee-4663-a47b-9021ff22ab81 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:33.573958 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:33.580846 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 695/1404] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:33.585935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38db9e0-8cee-4663-a47b-9021ff22ab81 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:33.592334 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d38db9e0-8cee-4663-a47b-9021ff22ab81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:33.680333 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7660c5c-00c3-4ac1-a9d3-e45bbcb02936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:33.682218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7660c5c-00c3-4ac1-a9d3-e45bbcb02936 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:33.767299 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 710/1405] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:33.770230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a769c-37f4-4a43-8d99-581158b4a0fd None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:33.770504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a769c-37f4-4a43-8d99-581158b4a0fd None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:33.770771 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a769c-37f4-4a43-8d99-581158b4a0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:33.919845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-3a2a769c-37f4-4a43-8d99-581158b4a0fd None None] MFA Rules not processed for user `4140f67775ef4de898e0d973bece67a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:33.924464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3a2a769c-37f4-4a43-8d99-581158b4a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:33.934349 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38db9e0-8cee-4663-a47b-9021ff22ab81 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:33.956145 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b762d-cf8b-4bb6-b32b-2c80c485b9f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:33.957720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b762d-cf8b-4bb6-b32b-2c80c485b9f0 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:33.957720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b762d-cf8b-4bb6-b32b-2c80c485b9f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:33.957988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b762d-cf8b-4bb6-b32b-2c80c485b9f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:33.961671 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ca7b762d-cf8b-4bb6-b32b-2c80c485b9f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:34.017014 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b762d-cf8b-4bb6-b32b-2c80c485b9f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:34.018908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b762d-cf8b-4bb6-b32b-2c80c485b9f0 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:34.040883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 696/1406] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:34.057137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b762d-cf8b-4bb6-b32b-2c80c485b9f0 service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:34.067904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ca7b762d-cf8b-4bb6-b32b-2c80c485b9f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:34.177642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 711/1407] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:34.178555 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a769c-37f4-4a43-8d99-581158b4a0fd None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:34.224141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a769c-37f4-4a43-8d99-581158b4a0fd None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:34.242848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff40b0-f755-4004-8e92-9b4a18f39828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:34.243864 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff40b0-f755-4004-8e92-9b4a18f39828 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:34.244211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff40b0-f755-4004-8e92-9b4a18f39828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:34.244703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff40b0-f755-4004-8e92-9b4a18f39828 admin admin] PATH_INFO: `/v3/projects/4b8879245622403b9f19f09094135486/users/f06433b906334a608e2d3c5f2d7faaf8/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:34.252401 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b762d-cf8b-4bb6-b32b-2c80c485b9f0 service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:34.256829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0fa2e-4eb8-4927-baea-cc5df76b386f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:34.257546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0fa2e-4eb8-4927-baea-cc5df76b386f service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:34.257825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0fa2e-4eb8-4927-baea-cc5df76b386f service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:34.258145 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0fa2e-4eb8-4927-baea-cc5df76b386f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:34.305095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff40b0-f755-4004-8e92-9b4a18f39828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8879245622403b9f19f09094135486, user_id=f06433b906334a608e2d3c5f2d7faaf8, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:34.308691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff40b0-f755-4004-8e92-9b4a18f39828 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:34.437554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0fa2e-4eb8-4927-baea-cc5df76b386f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:34.439114 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0fa2e-4eb8-4927-baea-cc5df76b386f service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:34.462788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 712/1408] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:34 2022] PUT /identity/v3/projects/4b8879245622403b9f19f09094135486/users/f06433b906334a608e2d3c5f2d7faaf8/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:34.467222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7432aca-e652-48b2-a96a-931d8392d548 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:34.467222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7432aca-e652-48b2-a96a-931d8392d548 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:34.467222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7432aca-e652-48b2-a96a-931d8392d548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:34.473700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 697/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:34.477414 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583767d-9374-4d9b-917a-2c45af79b467 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:34.477704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583767d-9374-4d9b-917a-2c45af79b467 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:34.477987 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583767d-9374-4d9b-917a-2c45af79b467 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:34.491256 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 698/1410] 10.222.0.45 () {54 vars in 961 bytes} [Mon Oct 31 15:09:34 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:09:34.495470 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583767d-9374-4d9b-917a-2c45af79b467 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:34.536453 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f7432aca-e652-48b2-a96a-931d8392d548 None None] MFA Rules not processed for user `093519cbc8564b859c01a3a3ab1aae3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:34.537714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f7432aca-e652-48b2-a96a-931d8392d548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:34.657479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583767d-9374-4d9b-917a-2c45af79b467 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:34.670530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b7d73-a382-4bff-8434-14e89275c134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:34.678526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7d73-a382-4bff-8434-14e89275c134 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:34.678975 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7d73-a382-4bff-8434-14e89275c134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:34.679351 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7d73-a382-4bff-8434-14e89275c134 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:34.681346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b7d73-a382-4bff-8434-14e89275c134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:34.684200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b7d73-a382-4bff-8434-14e89275c134 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:34.699099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 713/1411] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:34.700397 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee1956-a7ae-4ff0-bcda-48b93b2586b3 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:34.700683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee1956-a7ae-4ff0-bcda-48b93b2586b3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:34.700957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee1956-a7ae-4ff0-bcda-48b93b2586b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:34.731669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d9ee1956-a7ae-4ff0-bcda-48b93b2586b3 None None] MFA Rules not processed for user `4adb546848a744b3a3ed4d77bc02c0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:34.733590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d9ee1956-a7ae-4ff0-bcda-48b93b2586b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:34.806631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 699/1412] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:34 2022] POST /identity/v3/projects => generated 365 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:34.809161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a4f6f-b446-4817-85e9-484153761919 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:34.809776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a4f6f-b446-4817-85e9-484153761919 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:34.810595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a4f6f-b446-4817-85e9-484153761919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:34.829469 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 714/1413] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:34.831042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898eb0fc-53df-4154-a371-06bcb7f51012 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:34.831467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898eb0fc-53df-4154-a371-06bcb7f51012 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:34.832061 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898eb0fc-53df-4154-a371-06bcb7f51012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:34.853373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-365a4f6f-b446-4817-85e9-484153761919 None None] MFA Rules not processed for user `f06433b906334a608e2d3c5f2d7faaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:34.855811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-898eb0fc-53df-4154-a371-06bcb7f51012 None None] MFA Rules not processed for user `77b43d235d0441b3b8a272d051b54ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:34.856307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:34.857025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-365a4f6f-b446-4817-85e9-484153761919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:34.861095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-898eb0fc-53df-4154-a371-06bcb7f51012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:34.948878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 700/1414] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:34.949884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a4f6f-b446-4817-85e9-484153761919 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:34.977012 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 715/1415] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Oct 31 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:34.981192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a1e46-b3ba-425b-96de-4de97c9c8695 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:34.981674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a1e46-b3ba-425b-96de-4de97c9c8695 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:34.982492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a1e46-b3ba-425b-96de-4de97c9c8695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:35.033968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a4f6f-b446-4817-85e9-484153761919 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:35.040526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d32a1e46-b3ba-425b-96de-4de97c9c8695 None None] MFA Rules not processed for user `5d83b424ffbc4a879b490d9ac6e84ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:35.043056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec16ef-4068-4672-a2b3-c75b5db1a9c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:35.043223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d32a1e46-b3ba-425b-96de-4de97c9c8695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:35.046953 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec16ef-4068-4672-a2b3-c75b5db1a9c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:35.047443 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec16ef-4068-4672-a2b3-c75b5db1a9c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:35.049503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec16ef-4068-4672-a2b3-c75b5db1a9c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:35.054756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-62ec16ef-4068-4672-a2b3-c75b5db1a9c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:35.154376 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 716/1416] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:35.155437 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a1e46-b3ba-425b-96de-4de97c9c8695 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:35.192930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec16ef-4068-4672-a2b3-c75b5db1a9c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:35.194663 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec16ef-4068-4672-a2b3-c75b5db1a9c9 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:35.208463 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 701/1417] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:35.209473 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec16ef-4068-4672-a2b3-c75b5db1a9c9 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:35.270056 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a1e46-b3ba-425b-96de-4de97c9c8695 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:35.282691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbcf36-6f95-4aca-90e1-e3d00931325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:35.283333 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbcf36-6f95-4aca-90e1-e3d00931325f admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:35.283606 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbcf36-6f95-4aca-90e1-e3d00931325f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:35.283969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbcf36-6f95-4aca-90e1-e3d00931325f admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:35.284668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbcf36-6f95-4aca-90e1-e3d00931325f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:35.287984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbcf36-6f95-4aca-90e1-e3d00931325f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:35.342319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec16ef-4068-4672-a2b3-c75b5db1a9c9 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:35.355126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c3f3-6afc-4cfb-b512-5ee5f432f9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:35.356300 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c3f3-6afc-4cfb-b512-5ee5f432f9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:35.356300 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c3f3-6afc-4cfb-b512-5ee5f432f9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:35.357638 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2c3f3-6afc-4cfb-b512-5ee5f432f9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:35.358336 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2c3f3-6afc-4cfb-b512-5ee5f432f9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:35.362120 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2c3f3-6afc-4cfb-b512-5ee5f432f9c7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:35.417522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 717/1418] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:35 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:35.417522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbcf36-6f95-4aca-90e1-e3d00931325f admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:35.462554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbcf36-6f95-4aca-90e1-e3d00931325f admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:35.471757 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a099d-c56e-4cdf-8523-46e60ea333ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:35.472807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a099d-c56e-4cdf-8523-46e60ea333ee service placement] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:35.472807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a099d-c56e-4cdf-8523-46e60ea333ee service placement] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:35.472992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a099d-c56e-4cdf-8523-46e60ea333ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:35.495418 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a099d-c56e-4cdf-8523-46e60ea333ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:35.495418 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a099d-c56e-4cdf-8523-46e60ea333ee service placement] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:35.506454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 702/1419] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:35 2022] POST /identity/v3/projects => generated 383 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:35.507429 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c3f3-6afc-4cfb-b512-5ee5f432f9c7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:35.544289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 718/1420] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:35.546127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a099d-c56e-4cdf-8523-46e60ea333ee service placement] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:35.574454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a099d-c56e-4cdf-8523-46e60ea333ee service placement] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:35.633142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2c3f3-6afc-4cfb-b512-5ee5f432f9c7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:35.646775 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1b52e-d202-46af-a630-d07e9bc26ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:35.647541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1b52e-d202-46af-a630-d07e9bc26ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:35.647916 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1b52e-d202-46af-a630-d07e9bc26ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:35.648282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1b52e-d202-46af-a630-d07e9bc26ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:35.649034 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1b52e-d202-46af-a630-d07e9bc26ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:35.652316 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1b52e-d202-46af-a630-d07e9bc26ed6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:35.676377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 703/1421] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:35.680655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1b52e-d202-46af-a630-d07e9bc26ed6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:35.699780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49741d1e-018c-4739-a0c7-8fdb1f111bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:35.700935 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49741d1e-018c-4739-a0c7-8fdb1f111bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:35.701365 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49741d1e-018c-4739-a0c7-8fdb1f111bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:35.701728 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49741d1e-018c-4739-a0c7-8fdb1f111bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:35.706769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49741d1e-018c-4739-a0c7-8fdb1f111bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:35.708179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1b52e-d202-46af-a630-d07e9bc26ed6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:35.711480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49741d1e-018c-4739-a0c7-8fdb1f111bd1 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:35.722488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e4a26-ab6a-4e92-b11e-08a44e218f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:35.723732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e4a26-ab6a-4e92-b11e-08a44e218f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:35.724975 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e4a26-ab6a-4e92-b11e-08a44e218f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:35.726083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e4a26-ab6a-4e92-b11e-08a44e218f98 admin admin] PATH_INFO: `/v3/projects/89e84b5d92834e468db556f981c2e841/users/f8650efcfd4a444798d91dc34f7a2ddc/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:35.753908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e4a26-ab6a-4e92-b11e-08a44e218f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e84b5d92834e468db556f981c2e841, user_id=f8650efcfd4a444798d91dc34f7a2ddc, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:35.756872 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e4a26-ab6a-4e92-b11e-08a44e218f98 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:35.794087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:35.977405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 719/1422] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:35 2022] POST /identity/v3/users => generated 298 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:35.978501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49741d1e-018c-4739-a0c7-8fdb1f111bd1 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:35.980919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 704/1423] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:35 2022] PUT /identity/v3/projects/89e84b5d92834e468db556f981c2e841/users/f8650efcfd4a444798d91dc34f7a2ddc/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:35.984594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e4a26-ab6a-4e92-b11e-08a44e218f98 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:35.996126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49741d1e-018c-4739-a0c7-8fdb1f111bd1 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:36.076716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e4a26-ab6a-4e92-b11e-08a44e218f98 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:36.092425 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1811ad-4061-42eb-a4cb-17058cd78751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:36.093941 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1811ad-4061-42eb-a4cb-17058cd78751 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:36.094330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1811ad-4061-42eb-a4cb-17058cd78751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:36.094701 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1811ad-4061-42eb-a4cb-17058cd78751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:36.095462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1811ad-4061-42eb-a4cb-17058cd78751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:36.097821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1811ad-4061-42eb-a4cb-17058cd78751 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:36.099788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0e347-6bfe-46fc-bbb6-def5d47aa045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:36.100861 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0e347-6bfe-46fc-bbb6-def5d47aa045 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:36.100861 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0e347-6bfe-46fc-bbb6-def5d47aa045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:36.101133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0e347-6bfe-46fc-bbb6-def5d47aa045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:36.103966 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0e347-6bfe-46fc-bbb6-def5d47aa045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:36.107926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0e347-6bfe-46fc-bbb6-def5d47aa045 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:36.117371 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 705/1424] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:09:36.121507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1811ad-4061-42eb-a4cb-17058cd78751 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:36.132839 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 720/1425] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:09:36.138014 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0e347-6bfe-46fc-bbb6-def5d47aa045 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:36.147470 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1811ad-4061-42eb-a4cb-17058cd78751 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:36.149352 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0e347-6bfe-46fc-bbb6-def5d47aa045 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:36.153345 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47835e3b-b5ae-4e63-ac0b-dea2815b69f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:36.154056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47835e3b-b5ae-4e63-ac0b-dea2815b69f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:36.154161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0ecfe-2653-4cc6-ae3d-7ede31599715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:36.154334 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47835e3b-b5ae-4e63-ac0b-dea2815b69f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:36.154657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47835e3b-b5ae-4e63-ac0b-dea2815b69f7 admin admin] PATH_INFO: `/v3/projects/89e84b5d92834e468db556f981c2e841/users/f8650efcfd4a444798d91dc34f7a2ddc/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:36.156143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0ecfe-2653-4cc6-ae3d-7ede31599715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:36.156143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0ecfe-2653-4cc6-ae3d-7ede31599715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:36.156143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0ecfe-2653-4cc6-ae3d-7ede31599715 admin admin] PATH_INFO: `/v3/projects/b09dc97df259496bb98d282b0eb85ddf/users/331fd750a87b40ecb290a6403d299954/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:36.157408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47835e3b-b5ae-4e63-ac0b-dea2815b69f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e84b5d92834e468db556f981c2e841, user_id=f8650efcfd4a444798d91dc34f7a2ddc, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:36.173889 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0ecfe-2653-4cc6-ae3d-7ede31599715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09dc97df259496bb98d282b0eb85ddf, user_id=331fd750a87b40ecb290a6403d299954, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:36.174431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47835e3b-b5ae-4e63-ac0b-dea2815b69f7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:36.176931 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0ecfe-2653-4cc6-ae3d-7ede31599715 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:36.201978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 706/1426] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:36 2022] PUT /identity/v3/projects/89e84b5d92834e468db556f981c2e841/users/f8650efcfd4a444798d91dc34f7a2ddc/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:09:36.208051 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:36.213094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8eca3-d41d-4437-99dd-819c1e9f99b8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:36.213471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8eca3-d41d-4437-99dd-819c1e9f99b8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:36.213683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8eca3-d41d-4437-99dd-819c1e9f99b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:36.260178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-86e8eca3-d41d-4437-99dd-819c1e9f99b8 None None] MFA Rules not processed for user `f8650efcfd4a444798d91dc34f7a2ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:36.261800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-86e8eca3-d41d-4437-99dd-819c1e9f99b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:36.298329 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 721/1427] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:36 2022] PUT /identity/v3/projects/b09dc97df259496bb98d282b0eb85ddf/users/331fd750a87b40ecb290a6403d299954/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:09:36.302362 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0ecfe-2653-4cc6-ae3d-7ede31599715 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:36.430543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0ecfe-2653-4cc6-ae3d-7ede31599715 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:36.436322 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd957-f8c2-4637-a4a5-0eb478cb8a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:36.437596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd957-f8c2-4637-a4a5-0eb478cb8a7c admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:36.443651 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd957-f8c2-4637-a4a5-0eb478cb8a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:36.443651 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd957-f8c2-4637-a4a5-0eb478cb8a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:36.443651 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd957-f8c2-4637-a4a5-0eb478cb8a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:36.443651 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd957-f8c2-4637-a4a5-0eb478cb8a7c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:36.455746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 722/1428] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:09:36.459589 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd957-f8c2-4637-a4a5-0eb478cb8a7c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:36.472766 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd957-f8c2-4637-a4a5-0eb478cb8a7c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:36.473612 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 707/1429] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:36.479291 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f754e4-d464-4b03-8ff5-b662a57c4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:36.481976 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f754e4-d464-4b03-8ff5-b662a57c4ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:36.482267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f754e4-d464-4b03-8ff5-b662a57c4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:36.482622 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f754e4-d464-4b03-8ff5-b662a57c4ab2 admin admin] PATH_INFO: `/v3/projects/b09dc97df259496bb98d282b0eb85ddf/users/331fd750a87b40ecb290a6403d299954/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:36.485152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f754e4-d464-4b03-8ff5-b662a57c4ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b09dc97df259496bb98d282b0eb85ddf, user_id=331fd750a87b40ecb290a6403d299954, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:36.486378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8eca3-d41d-4437-99dd-819c1e9f99b8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:36.502195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f754e4-d464-4b03-8ff5-b662a57c4ab2 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:36.536071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 723/1430] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:36 2022] PUT /identity/v3/projects/b09dc97df259496bb98d282b0eb85ddf/users/331fd750a87b40ecb290a6403d299954/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:36.552995 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae07219-c4df-414e-9ee0-23936ae7b4f7 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:36.553456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae07219-c4df-414e-9ee0-23936ae7b4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:36.553639 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae07219-c4df-414e-9ee0-23936ae7b4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:36.679999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8eca3-d41d-4437-99dd-819c1e9f99b8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:36.688108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0ae07219-c4df-414e-9ee0-23936ae7b4f7 None None] MFA Rules not processed for user `331fd750a87b40ecb290a6403d299954`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:36.694107 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0ae07219-c4df-414e-9ee0-23936ae7b4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:36.900982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 724/1431] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:36.913750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae07219-c4df-414e-9ee0-23936ae7b4f7 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:36.915814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d31885-a98c-4fbb-9cdd-f3d91b7ef92e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:36.916974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0ae07219-c4df-414e-9ee0-23936ae7b4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:36.919929 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d31885-a98c-4fbb-9cdd-f3d91b7ef92e service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:36.921367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d31885-a98c-4fbb-9cdd-f3d91b7ef92e service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:36.926858 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d31885-a98c-4fbb-9cdd-f3d91b7ef92e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:36.967137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae07219-c4df-414e-9ee0-23936ae7b4f7 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:36.979914 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c924d0d-e534-4c0c-b45f-b9d75590cf23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:36.980602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c924d0d-e534-4c0c-b45f-b9d75590cf23 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:36.981949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c924d0d-e534-4c0c-b45f-b9d75590cf23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:36.986311 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c924d0d-e534-4c0c-b45f-b9d75590cf23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:37.044389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c924d0d-e534-4c0c-b45f-b9d75590cf23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:37.045888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c924d0d-e534-4c0c-b45f-b9d75590cf23 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:37.050543 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d31885-a98c-4fbb-9cdd-f3d91b7ef92e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:37.052448 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d31885-a98c-4fbb-9cdd-f3d91b7ef92e service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:37.101656 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 725/1432] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:37.119320 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 708/1433] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:37.163484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c924d0d-e534-4c0c-b45f-b9d75590cf23 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:37.329993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c924d0d-e534-4c0c-b45f-b9d75590cf23 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:37.354565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:37.355273 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:37.355552 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:37.355818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] PATH_INFO: `/v3/users/f06433b906334a608e2d3c5f2d7faaf8` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:37.357522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f06433b906334a608e2d3c5f2d7faaf8)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:37.360527 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:37.748512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f06433b906334a608e2d3c5f2d7faaf8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:37.757198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f06433b906334a608e2d3c5f2d7faaf8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:37.811012 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f06433b906334a608e2d3c5f2d7faaf8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:37.811012 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f06433b906334a608e2d3c5f2d7faaf8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:37.925063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f06433b906334a608e2d3c5f2d7faaf8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:37.957702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 726/1434] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:37 2022] DELETE /identity/v3/users/f06433b906334a608e2d3c5f2d7faaf8 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:37.959834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea84ce5-5d0b-40de-9c0c-11c36b89f74f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:37.960339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea84ce5-5d0b-40de-9c0c-11c36b89f74f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:37.962866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea84ce5-5d0b-40de-9c0c-11c36b89f74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:38.021385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5ea84ce5-5d0b-40de-9c0c-11c36b89f74f None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:38.022635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5ea84ce5-5d0b-40de-9c0c-11c36b89f74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:38.184294 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 709/1435] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:38.196246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:38.197750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:38.430242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7c495-2673-49d1-be3f-10e260b0300a admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:38.440043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd06d8-767a-4852-a72f-e4363e4afa7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:38.440926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd06d8-767a-4852-a72f-e4363e4afa7d service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:38.441368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd06d8-767a-4852-a72f-e4363e4afa7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:38.441905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd06d8-767a-4852-a72f-e4363e4afa7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:38.474121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd06d8-767a-4852-a72f-e4363e4afa7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:38.477845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd06d8-767a-4852-a72f-e4363e4afa7d service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:38.516432 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 727/1436] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:38.650763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:38.788427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea84ce5-5d0b-40de-9c0c-11c36b89f74f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:38.793327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5ea84ce5-5d0b-40de-9c0c-11c36b89f74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:38.820828 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea84ce5-5d0b-40de-9c0c-11c36b89f74f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:38.831385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:38.833210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:38.838096 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:38.838552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] PATH_INFO: `/v3/users/4140f67775ef4de898e0d973bece67a4` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:38.866399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4140f67775ef4de898e0d973bece67a4)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:38.870199 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:39.191333 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4140f67775ef4de898e0d973bece67a4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:39.192844 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4140f67775ef4de898e0d973bece67a4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:39.201785 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4140f67775ef4de898e0d973bece67a4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:39.335947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4140f67775ef4de898e0d973bece67a4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:39.349698 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4140f67775ef4de898e0d973bece67a4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:39.355910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 710/1437] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:38 2022] DELETE /identity/v3/users/4140f67775ef4de898e0d973bece67a4 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:39.360478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb10cac-d489-4d1b-8059-423dfb94ca74 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:39.360954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb10cac-d489-4d1b-8059-423dfb94ca74 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:39.361038 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb10cac-d489-4d1b-8059-423dfb94ca74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:39.380702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-bfb10cac-d489-4d1b-8059-423dfb94ca74 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:39.381959 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-bfb10cac-d489-4d1b-8059-423dfb94ca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:39.423263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:39.440282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:39.441819 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:39.472106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 728/1438] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:39.482012 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb10cac-d489-4d1b-8059-423dfb94ca74 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:39.483424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-bfb10cac-d489-4d1b-8059-423dfb94ca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:39.597010 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e8fd2-40ba-469a-a427-e3a2fcaadd7d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:39.608073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:39.610762 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:39.611159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:39.611477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] PATH_INFO: `/v3/projects/4b8879245622403b9f19f09094135486` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:39.616785 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8879245622403b9f19f09094135486)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:39.620130 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:39.647721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb10cac-d489-4d1b-8059-423dfb94ca74 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:39.672581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c94a-36bc-4f4e-ae06-e70a9c7a2280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:39.679624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c94a-36bc-4f4e-ae06-e70a9c7a2280 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:39.679624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c94a-36bc-4f4e-ae06-e70a9c7a2280 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:39.679624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c94a-36bc-4f4e-ae06-e70a9c7a2280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:39.716209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2c94a-36bc-4f4e-ae06-e70a9c7a2280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:39.717879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2c94a-36bc-4f4e-ae06-e70a9c7a2280 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:39.771178 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 729/1439] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:39.886012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:39.932800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8879245622403b9f19f09094135486', 'request_id': 'req-18c4af03-d089-4583-84e3-8dfe479abb78'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.105303 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8879245622403b9f19f09094135486', 'request_id': 'req-18c4af03-d089-4583-84e3-8dfe479abb78'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.112792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8879245622403b9f19f09094135486', 'request_id': 'req-18c4af03-d089-4583-84e3-8dfe479abb78'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.159374 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] The token cache is being invalidate because project 4b8879245622403b9f19f09094135486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:40.161236 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.162561 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.167983 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 711/1440] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:39 2022] DELETE /identity/v3/projects/4b8879245622403b9f19f09094135486 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:40.172628 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c94a-36bc-4f4e-ae06-e70a9c7a2280 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:40.188210 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c94a-36bc-4f4e-ae06-e70a9c7a2280 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:40.264683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:40.266185 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:40.267141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:40.267608 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] PATH_INFO: `/v3/users/331fd750a87b40ecb290a6403d299954` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:40.268874 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] RBAC: Authorizing `identity:delete_user(user_id=331fd750a87b40ecb290a6403d299954)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:40.271094 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:40.470438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:40.472701 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:40.495574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4af03-d089-4583-84e3-8dfe479abb78 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:40.502090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:40.502990 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:40.503469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:40.503921 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f admin admin] PATH_INFO: `/v3/projects/fb21460eda92439d83c7c10dee657902` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:40.505374 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb21460eda92439d83c7c10dee657902)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:40.507769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:40.576182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '331fd750a87b40ecb290a6403d299954'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.576546 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '331fd750a87b40ecb290a6403d299954'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.592223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '331fd750a87b40ecb290a6403d299954'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.593787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '331fd750a87b40ecb290a6403d299954'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.681102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb21460eda92439d83c7c10dee657902', 'request_id': 'req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.742078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '331fd750a87b40ecb290a6403d299954'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.763272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 730/1441] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:40 2022] DELETE /identity/v3/users/331fd750a87b40ecb290a6403d299954 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:40.763272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:40.777733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:40.851071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb21460eda92439d83c7c10dee657902', 'request_id': 'req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.863946 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb21460eda92439d83c7c10dee657902', 'request_id': 'req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.914847 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f admin admin] The token cache is being invalidate because project fb21460eda92439d83c7c10dee657902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:40.915141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.921496 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4cdd2282-fbd7-46d4-99f2-fc1ff255ca1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:40.928807 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 712/1442] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:40 2022] DELETE /identity/v3/projects/fb21460eda92439d83c7c10dee657902 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:40.933690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a95c40-2861-492b-90a9-3ebecaa1f37a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:40.933921 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a95c40-2861-492b-90a9-3ebecaa1f37a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:40.937557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a95c40-2861-492b-90a9-3ebecaa1f37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:40.948058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea2b13-0b4e-4f11-8787-2fb11455841d admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:40.966024 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48ba58-0278-49a6-9142-f03ba45786ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:40.969123 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48ba58-0278-49a6-9142-f03ba45786ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:40.969123 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48ba58-0278-49a6-9142-f03ba45786ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:40.969123 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48ba58-0278-49a6-9142-f03ba45786ec admin admin] PATH_INFO: `/v3/users/11f0fc8116f04e5e89c04e678a0383de` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:40.974411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48ba58-0278-49a6-9142-f03ba45786ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=11f0fc8116f04e5e89c04e678a0383de)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:40.976673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48ba58-0278-49a6-9142-f03ba45786ec admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:41.089833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:41.149693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-64a95c40-2861-492b-90a9-3ebecaa1f37a None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:41.151223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-64a95c40-2861-492b-90a9-3ebecaa1f37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:41.269900 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7c48ba58-0278-49a6-9142-f03ba45786ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11f0fc8116f04e5e89c04e678a0383de'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:41.273268 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7c48ba58-0278-49a6-9142-f03ba45786ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11f0fc8116f04e5e89c04e678a0383de'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:41.332083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7c48ba58-0278-49a6-9142-f03ba45786ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11f0fc8116f04e5e89c04e678a0383de'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:41.335384 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7c48ba58-0278-49a6-9142-f03ba45786ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11f0fc8116f04e5e89c04e678a0383de'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:41.353690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 713/1443] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:09:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:41.354983 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a95c40-2861-492b-90a9-3ebecaa1f37a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:41.356891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-64a95c40-2861-492b-90a9-3ebecaa1f37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:41.382050 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a95c40-2861-492b-90a9-3ebecaa1f37a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:41.390325 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56ae29-b3f2-4667-bde2-5872bd2abd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:41.392369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56ae29-b3f2-4667-bde2-5872bd2abd5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:41.402717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56ae29-b3f2-4667-bde2-5872bd2abd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:41.402717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56ae29-b3f2-4667-bde2-5872bd2abd5e admin admin] PATH_INFO: `/v3/users/f8650efcfd4a444798d91dc34f7a2ddc` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:41.402717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56ae29-b3f2-4667-bde2-5872bd2abd5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8650efcfd4a444798d91dc34f7a2ddc)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:41.402717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56ae29-b3f2-4667-bde2-5872bd2abd5e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:41.512932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7c48ba58-0278-49a6-9142-f03ba45786ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11f0fc8116f04e5e89c04e678a0383de'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:41.535941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 731/1444] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:40 2022] DELETE /identity/v3/users/11f0fc8116f04e5e89c04e678a0383de => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:41.541070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee7c30-c710-4b32-9ee2-5d35ae186e69 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:41.541386 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee7c30-c710-4b32-9ee2-5d35ae186e69 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:41.541803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee7c30-c710-4b32-9ee2-5d35ae186e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:41.588127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-13ee7c30-c710-4b32-9ee2-5d35ae186e69 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:41.589449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-13ee7c30-c710-4b32-9ee2-5d35ae186e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:41.680448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 732/1445] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:41.681527 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee7c30-c710-4b32-9ee2-5d35ae186e69 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:41.683310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-13ee7c30-c710-4b32-9ee2-5d35ae186e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:41.694396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ad56ae29-b3f2-4667-bde2-5872bd2abd5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8650efcfd4a444798d91dc34f7a2ddc'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:41.695964 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ad56ae29-b3f2-4667-bde2-5872bd2abd5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8650efcfd4a444798d91dc34f7a2ddc'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:41.715250 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ad56ae29-b3f2-4667-bde2-5872bd2abd5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8650efcfd4a444798d91dc34f7a2ddc'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:41.769977 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee7c30-c710-4b32-9ee2-5d35ae186e69 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:41.774695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dc11d-e29e-4414-a524-dac4ab6096a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:41.775369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dc11d-e29e-4414-a524-dac4ab6096a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:41.775730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dc11d-e29e-4414-a524-dac4ab6096a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:41.776052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dc11d-e29e-4414-a524-dac4ab6096a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:41.779227 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f08dc11d-e29e-4414-a524-dac4ab6096a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:41.794420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dc11d-e29e-4414-a524-dac4ab6096a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:41.796216 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dc11d-e29e-4414-a524-dac4ab6096a7 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:41.815581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 733/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:41.816775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dc11d-e29e-4414-a524-dac4ab6096a7 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:41.818460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f08dc11d-e29e-4414-a524-dac4ab6096a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:41.833259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ad56ae29-b3f2-4667-bde2-5872bd2abd5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8650efcfd4a444798d91dc34f7a2ddc'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:41.850342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ad56ae29-b3f2-4667-bde2-5872bd2abd5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8650efcfd4a444798d91dc34f7a2ddc'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:41.881095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 714/1447] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:41 2022] DELETE /identity/v3/users/f8650efcfd4a444798d91dc34f7a2ddc => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:42.062036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:42.126956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dc11d-e29e-4414-a524-dac4ab6096a7 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:42.282334 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d427e04-ccc0-4e1a-b479-85e822dd7860 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:42.283199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d427e04-ccc0-4e1a-b479-85e822dd7860 service swift] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:42.283616 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d427e04-ccc0-4e1a-b479-85e822dd7860 service swift] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:42.284120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d427e04-ccc0-4e1a-b479-85e822dd7860 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:42.286950 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7d427e04-ccc0-4e1a-b479-85e822dd7860 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:42.486939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d427e04-ccc0-4e1a-b479-85e822dd7860 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:42.487031 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62ec90-7525-4404-be3b-27a0b937ce6b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:42.487031 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62ec90-7525-4404-be3b-27a0b937ce6b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:42.487031 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62ec90-7525-4404-be3b-27a0b937ce6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:42.487676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d427e04-ccc0-4e1a-b479-85e822dd7860 service swift] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:42.509027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 734/1448] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:09:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:09:42.532420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d427e04-ccc0-4e1a-b479-85e822dd7860 service swift] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:42.534441 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7d427e04-ccc0-4e1a-b479-85e822dd7860 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:42.554539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4c62ec90-7525-4404-be3b-27a0b937ce6b None None] MFA Rules not processed for user `93815827ae97419abf6fa45fbab185f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:42.559070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4c62ec90-7525-4404-be3b-27a0b937ce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:42.701136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d427e04-ccc0-4e1a-b479-85e822dd7860 service swift] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:42.709804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:42.711157 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:42.717122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:42.717122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9 admin admin] PATH_INFO: `/v3/projects/b09dc97df259496bb98d282b0eb85ddf` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:42.717122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b09dc97df259496bb98d282b0eb85ddf)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:42.717122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:42.747947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 715/1449] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Oct 31 15:09:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:09:42.938398 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09dc97df259496bb98d282b0eb85ddf', 'request_id': 'req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:43.057255 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62ec90-7525-4404-be3b-27a0b937ce6b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:43.057494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09dc97df259496bb98d282b0eb85ddf', 'request_id': 'req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:43.060324 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4c62ec90-7525-4404-be3b-27a0b937ce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:43.070241 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09dc97df259496bb98d282b0eb85ddf', 'request_id': 'req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:43.081758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62ec90-7525-4404-be3b-27a0b937ce6b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:43.121209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9 admin admin] The token cache is being invalidate because project b09dc97df259496bb98d282b0eb85ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:43.121842 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:43.122586 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-be8e15f2-8e67-4139-aa5e-5dffad0a19c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:43.127150 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 735/1450] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:42 2022] DELETE /identity/v3/projects/b09dc97df259496bb98d282b0eb85ddf => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:43.134761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c6095-48ea-41c9-9d90-d333b9e1e735 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:43.137605 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c6095-48ea-41c9-9d90-d333b9e1e735 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:43.138030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c6095-48ea-41c9-9d90-d333b9e1e735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:43.209325 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-8c6c6095-48ea-41c9-9d90-d333b9e1e735 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:43.211228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-8c6c6095-48ea-41c9-9d90-d333b9e1e735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:43.258193 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23364b5-29af-4a7f-9187-91306cf351c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:43.258957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23364b5-29af-4a7f-9187-91306cf351c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:43.259245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23364b5-29af-4a7f-9187-91306cf351c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:43.259520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23364b5-29af-4a7f-9187-91306cf351c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:43.266647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a23364b5-29af-4a7f-9187-91306cf351c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:43.297238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23364b5-29af-4a7f-9187-91306cf351c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:43.298799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23364b5-29af-4a7f-9187-91306cf351c9 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:43.338204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 716/1451] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:09:43.339135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23364b5-29af-4a7f-9187-91306cf351c9 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:43.341852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a23364b5-29af-4a7f-9187-91306cf351c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:43.432306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:43.477823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 736/1452] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:43.480692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c6095-48ea-41c9-9d90-d333b9e1e735 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:43.485895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-8c6c6095-48ea-41c9-9d90-d333b9e1e735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:43.507075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c6095-48ea-41c9-9d90-d333b9e1e735 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:43.513093 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281421fa-da22-4e71-ae98-4dd1d44c87ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:43.513768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281421fa-da22-4e71-ae98-4dd1d44c87ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:43.514102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281421fa-da22-4e71-ae98-4dd1d44c87ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:43.514444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281421fa-da22-4e71-ae98-4dd1d44c87ac admin admin] PATH_INFO: `/v3/projects/45d98ca6c4ab43c7bde6a76dbacd487f` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:43.516483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281421fa-da22-4e71-ae98-4dd1d44c87ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d98ca6c4ab43c7bde6a76dbacd487f)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:43.519284 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281421fa-da22-4e71-ae98-4dd1d44c87ac admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:43.629880 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23364b5-29af-4a7f-9187-91306cf351c9 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:43.643782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:43.645987 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:43.647555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:43.649059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] PATH_INFO: `/v3/projects/89e84b5d92834e468db556f981c2e841` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:43.652029 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e84b5d92834e468db556f981c2e841)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:43.658313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:43.706134 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-281421fa-da22-4e71-ae98-4dd1d44c87ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d98ca6c4ab43c7bde6a76dbacd487f', 'request_id': 'req-281421fa-da22-4e71-ae98-4dd1d44c87ac'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:43.993057 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-281421fa-da22-4e71-ae98-4dd1d44c87ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d98ca6c4ab43c7bde6a76dbacd487f', 'request_id': 'req-281421fa-da22-4e71-ae98-4dd1d44c87ac'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.015761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-281421fa-da22-4e71-ae98-4dd1d44c87ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d98ca6c4ab43c7bde6a76dbacd487f', 'request_id': 'req-281421fa-da22-4e71-ae98-4dd1d44c87ac'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.050032 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-281421fa-da22-4e71-ae98-4dd1d44c87ac admin admin] The token cache is being invalidate because project 45d98ca6c4ab43c7bde6a76dbacd487f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:44.050394 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-281421fa-da22-4e71-ae98-4dd1d44c87ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.051393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-281421fa-da22-4e71-ae98-4dd1d44c87ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.056781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 737/1453] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:43 2022] DELETE /identity/v3/projects/45d98ca6c4ab43c7bde6a76dbacd487f => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:44.056781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de0072-f441-444f-8741-309312121307 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:44.056781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de0072-f441-444f-8741-309312121307 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:44.056781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de0072-f441-444f-8741-309312121307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:44.098512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-a6de0072-f441-444f-8741-309312121307 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:44.099703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a6de0072-f441-444f-8741-309312121307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:44.317999 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 738/1454] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:44.317999 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de0072-f441-444f-8741-309312121307 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:44.319045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a6de0072-f441-444f-8741-309312121307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:44.361376 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de0072-f441-444f-8741-309312121307 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:44.387708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:44.389833 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:44.391379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:44.391777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] PATH_INFO: `/v3/users/b1fe13f7b0284e75b847c3761063d0b3` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:44.393414 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1fe13f7b0284e75b847c3761063d0b3)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:44.398059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:44.500607 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e84b5d92834e468db556f981c2e841', 'request_id': 'req-7d278a45-3c36-454d-8202-bc8ed7bb9058'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.723175 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e84b5d92834e468db556f981c2e841', 'request_id': 'req-7d278a45-3c36-454d-8202-bc8ed7bb9058'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.749255 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e84b5d92834e468db556f981c2e841', 'request_id': 'req-7d278a45-3c36-454d-8202-bc8ed7bb9058'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.791580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] The token cache is being invalidate because project 89e84b5d92834e468db556f981c2e841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:44.791967 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.794877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.797700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1fe13f7b0284e75b847c3761063d0b3'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.798292 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 717/1455] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:43 2022] DELETE /identity/v3/projects/89e84b5d92834e468db556f981c2e841 => generated 0 bytes in 1459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:44.798914 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1fe13f7b0284e75b847c3761063d0b3'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.799250 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:44.801863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:44.804823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:44.835265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1fe13f7b0284e75b847c3761063d0b3'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.836438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1fe13f7b0284e75b847c3761063d0b3'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.900684 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d278a45-3c36-454d-8202-bc8ed7bb9058 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:44.936043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121810ef-5ec0-4e38-81b4-2c81ae58ae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:44.936043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121810ef-5ec0-4e38-81b4-2c81ae58ae73 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:44.936043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121810ef-5ec0-4e38-81b4-2c81ae58ae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:44.936043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121810ef-5ec0-4e38-81b4-2c81ae58ae73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:44.936491 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121810ef-5ec0-4e38-81b4-2c81ae58ae73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:44.936491 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121810ef-5ec0-4e38-81b4-2c81ae58ae73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:44.936491 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121810ef-5ec0-4e38-81b4-2c81ae58ae73 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:44.952577 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1fe13f7b0284e75b847c3761063d0b3'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:44.962866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 718/1456] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:44.963921 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b44f7-acfb-467b-bf32-445c092fd71e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:44.964225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b44f7-acfb-467b-bf32-445c092fd71e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:44.964929 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b44f7-acfb-467b-bf32-445c092fd71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:44.991291 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 739/1457] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:44 2022] DELETE /identity/v3/users/b1fe13f7b0284e75b847c3761063d0b3 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:44.992160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:44.994746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:45.045795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-001b44f7-acfb-467b-bf32-445c092fd71e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:45.045795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-001b44f7-acfb-467b-bf32-445c092fd71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:45.229221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 719/1458] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:45.229467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344fc2f-d8e1-483f-8578-d84b0a2bd037 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:45.230989 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef492e5-c32c-4b4b-a6f6-3172ed7c4371 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:45.231744 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef492e5-c32c-4b4b-a6f6-3172ed7c4371 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:45.231744 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef492e5-c32c-4b4b-a6f6-3172ed7c4371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:45.237596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4643a-0e0a-482c-9539-b89aa86c27ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:45.253348 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4643a-0e0a-482c-9539-b89aa86c27ff admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:45.253348 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4643a-0e0a-482c-9539-b89aa86c27ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:45.253348 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4643a-0e0a-482c-9539-b89aa86c27ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:45.253348 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4643a-0e0a-482c-9539-b89aa86c27ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:45.253348 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4643a-0e0a-482c-9539-b89aa86c27ff admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:45.295063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-eef492e5-c32c-4b4b-a6f6-3172ed7c4371 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:45.296373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-eef492e5-c32c-4b4b-a6f6-3172ed7c4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:45.334089 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 720/1459] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:09:45.338954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef492e5-c32c-4b4b-a6f6-3172ed7c4371 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:45.349503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef492e5-c32c-4b4b-a6f6-3172ed7c4371 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:45.366251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f871-8575-44f3-a77e-88dc79938ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:45.366953 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f871-8575-44f3-a77e-88dc79938ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:45.367256 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f871-8575-44f3-a77e-88dc79938ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:45.367523 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4f871-8575-44f3-a77e-88dc79938ad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:45.368271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4f871-8575-44f3-a77e-88dc79938ad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:45.368601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4f871-8575-44f3-a77e-88dc79938ad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:45.370427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4f871-8575-44f3-a77e-88dc79938ad2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:45.413339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 721/1460] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:45.418277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f871-8575-44f3-a77e-88dc79938ad2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:45.447072 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4f871-8575-44f3-a77e-88dc79938ad2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:45.457799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e70f5-3c8a-45bb-a794-80c8393a383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:45.458760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e70f5-3c8a-45bb-a794-80c8393a383f admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:45.459190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e70f5-3c8a-45bb-a794-80c8393a383f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:45.459313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 740/1461] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:44 2022] POST /identity/v3/projects => generated 381 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:45.459745 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e70f5-3c8a-45bb-a794-80c8393a383f admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:45.460487 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e70f5-3c8a-45bb-a794-80c8393a383f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:45.462377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e70f5-3c8a-45bb-a794-80c8393a383f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:45.463647 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4643a-0e0a-482c-9539-b89aa86c27ff admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:45.589094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 722/1462] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:45 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:09:45.590135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e70f5-3c8a-45bb-a794-80c8393a383f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:45.642417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4643a-0e0a-482c-9539-b89aa86c27ff admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:45.755580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e70f5-3c8a-45bb-a794-80c8393a383f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:45.768400 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321131-1b0b-40ea-b55d-89313e53effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:45.769140 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321131-1b0b-40ea-b55d-89313e53effa admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:45.769510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321131-1b0b-40ea-b55d-89313e53effa admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:45.769857 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321131-1b0b-40ea-b55d-89313e53effa admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:45.770580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321131-1b0b-40ea-b55d-89313e53effa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:45.772608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321131-1b0b-40ea-b55d-89313e53effa admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:45.774829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a9de5-5f1b-430e-a33d-1a95111784cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:45.778225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9de5-5f1b-430e-a33d-1a95111784cb admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:45.778225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9de5-5f1b-430e-a33d-1a95111784cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:45.778225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a9de5-5f1b-430e-a33d-1a95111784cb admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:45.778225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a9de5-5f1b-430e-a33d-1a95111784cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:45.778682 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a9de5-5f1b-430e-a33d-1a95111784cb admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:46.011710 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 741/1463] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:45 2022] POST /identity/v3/users => generated 291 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:46.016008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 723/1464] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:45 2022] POST /identity/v3/users => generated 283 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:09:46.016674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321131-1b0b-40ea-b55d-89313e53effa admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:46.016809 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a9de5-5f1b-430e-a33d-1a95111784cb admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:46.036754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a9de5-5f1b-430e-a33d-1a95111784cb admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:46.050356 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f30d23-b14b-4fdd-ab3c-b1ddd92565e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:46.053084 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f30d23-b14b-4fdd-ab3c-b1ddd92565e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:46.053084 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f30d23-b14b-4fdd-ab3c-b1ddd92565e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:46.053084 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f30d23-b14b-4fdd-ab3c-b1ddd92565e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:46.053084 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f30d23-b14b-4fdd-ab3c-b1ddd92565e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:46.054360 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f30d23-b14b-4fdd-ab3c-b1ddd92565e5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:46.058004 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321131-1b0b-40ea-b55d-89313e53effa admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:46.063974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38443ce5-21b8-4bc5-8674-97166ee004de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:46.064735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38443ce5-21b8-4bc5-8674-97166ee004de admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:46.065319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38443ce5-21b8-4bc5-8674-97166ee004de admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:46.065319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38443ce5-21b8-4bc5-8674-97166ee004de admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:46.066291 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38443ce5-21b8-4bc5-8674-97166ee004de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:46.068970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38443ce5-21b8-4bc5-8674-97166ee004de admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:46.087913 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 742/1465] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:46.089272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f30d23-b14b-4fdd-ab3c-b1ddd92565e5 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:46.101694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f30d23-b14b-4fdd-ab3c-b1ddd92565e5 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:46.105257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 724/1466] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:46.106176 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38443ce5-21b8-4bc5-8674-97166ee004de admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:46.107817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1ddb7-4f9e-472e-bdc1-c80292611986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:46.109118 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1ddb7-4f9e-472e-bdc1-c80292611986 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:46.110193 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1ddb7-4f9e-472e-bdc1-c80292611986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:46.110935 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1ddb7-4f9e-472e-bdc1-c80292611986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:46.113480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1ddb7-4f9e-472e-bdc1-c80292611986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:46.115614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1ddb7-4f9e-472e-bdc1-c80292611986 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:46.127687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38443ce5-21b8-4bc5-8674-97166ee004de admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:46.134075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 743/1467] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:46.139386 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1ddb7-4f9e-472e-bdc1-c80292611986 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:46.143504 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bd14d-fdf4-4ef1-bd39-0a77e8812e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:46.144142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bd14d-fdf4-4ef1-bd39-0a77e8812e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:46.144425 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bd14d-fdf4-4ef1-bd39-0a77e8812e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:46.144699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bd14d-fdf4-4ef1-bd39-0a77e8812e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:46.145403 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bd14d-fdf4-4ef1-bd39-0a77e8812e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:46.147007 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bd14d-fdf4-4ef1-bd39-0a77e8812e4a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:46.157142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1ddb7-4f9e-472e-bdc1-c80292611986 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:46.163696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef272000-b7f6-4f91-b312-6447c82b8648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:46.164064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef272000-b7f6-4f91-b312-6447c82b8648 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:46.164383 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef272000-b7f6-4f91-b312-6447c82b8648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:46.164954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef272000-b7f6-4f91-b312-6447c82b8648 admin admin] PATH_INFO: `/v3/projects/c614c6d803f545f0bea7109359d2f74d/users/f1cad016d47d4dfdaec93e702e1254e3/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:46.176155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 725/1468] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:46.193076 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bd14d-fdf4-4ef1-bd39-0a77e8812e4a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:46.206478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef272000-b7f6-4f91-b312-6447c82b8648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c614c6d803f545f0bea7109359d2f74d, user_id=f1cad016d47d4dfdaec93e702e1254e3, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:46.211651 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef272000-b7f6-4f91-b312-6447c82b8648 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:46.242406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bd14d-fdf4-4ef1-bd39-0a77e8812e4a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:46.261956 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847e52c-78b1-465f-bffe-ab9b7c69adfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:46.263000 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847e52c-78b1-465f-bffe-ab9b7c69adfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:46.263435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847e52c-78b1-465f-bffe-ab9b7c69adfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:46.264347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847e52c-78b1-465f-bffe-ab9b7c69adfa admin admin] PATH_INFO: `/v3/projects/a7e646ea53b14d118f9117713465c499/users/c180534328ea41c39ae13b860ecdf974/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:46.283317 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:46.329604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 744/1469] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:46 2022] PUT /identity/v3/projects/c614c6d803f545f0bea7109359d2f74d/users/f1cad016d47d4dfdaec93e702e1254e3/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:46.334495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219a5f2-2c7d-49e9-a504-937bfce38d63 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:46.334495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219a5f2-2c7d-49e9-a504-937bfce38d63 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:46.334937 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219a5f2-2c7d-49e9-a504-937bfce38d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:46.365324 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847e52c-78b1-465f-bffe-ab9b7c69adfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e646ea53b14d118f9117713465c499, user_id=c180534328ea41c39ae13b860ecdf974, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:46.368705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847e52c-78b1-465f-bffe-ab9b7c69adfa admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:46.402171 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-5219a5f2-2c7d-49e9-a504-937bfce38d63 None None] MFA Rules not processed for user `f1cad016d47d4dfdaec93e702e1254e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:46.402171 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5219a5f2-2c7d-49e9-a504-937bfce38d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:46.519596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 726/1470] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:46 2022] PUT /identity/v3/projects/a7e646ea53b14d118f9117713465c499/users/c180534328ea41c39ae13b860ecdf974/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:46.531400 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72535b88-d61e-40ff-8c61-3165ed59c893 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:46.531782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72535b88-d61e-40ff-8c61-3165ed59c893 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:46.531942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72535b88-d61e-40ff-8c61-3165ed59c893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:46.575405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 745/1471] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:46.575405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdbc70-30ce-4210-b689-6fc739977a50 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:46.575405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdbc70-30ce-4210-b689-6fc739977a50 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:46.575405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdbc70-30ce-4210-b689-6fc739977a50 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:46.579879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 746/1472] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 31 15:09:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:09:46.580874 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdbc70-30ce-4210-b689-6fc739977a50 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:46.581254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-72535b88-d61e-40ff-8c61-3165ed59c893 None None] MFA Rules not processed for user `c180534328ea41c39ae13b860ecdf974`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:46.582714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-72535b88-d61e-40ff-8c61-3165ed59c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:46.700625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 727/1473] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:09:46.702611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c7d3e-c806-417c-b9e0-80e3b202600e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:46.702973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c7d3e-c806-417c-b9e0-80e3b202600e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:46.703318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c7d3e-c806-417c-b9e0-80e3b202600e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:46.733241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fb5c7d3e-c806-417c-b9e0-80e3b202600e None None] MFA Rules not processed for user `9ec30e419d6f4fddb05c4bb08f2ce3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:46.733241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fb5c7d3e-c806-417c-b9e0-80e3b202600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:46.750710 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdbc70-30ce-4210-b689-6fc739977a50 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:46.756768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3e7c7-b35b-4281-b4fc-62f6e71001bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:46.758105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3e7c7-b35b-4281-b4fc-62f6e71001bf admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:46.758105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3e7c7-b35b-4281-b4fc-62f6e71001bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:46.758501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3e7c7-b35b-4281-b4fc-62f6e71001bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:46.759448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3e7c7-b35b-4281-b4fc-62f6e71001bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:46.761777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3e7c7-b35b-4281-b4fc-62f6e71001bf admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:46.920541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 728/1474] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 31 15:09:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:46.927166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c7d3e-c806-417c-b9e0-80e3b202600e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:46.936109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 747/1475] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:46 2022] POST /identity/v3/projects => generated 381 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:46.940706 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3e7c7-b35b-4281-b4fc-62f6e71001bf admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:46.983879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c7d3e-c806-417c-b9e0-80e3b202600e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:47.087260 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3e7c7-b35b-4281-b4fc-62f6e71001bf admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:47.107243 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20684be9-6dcc-4432-9931-b15b12cb0679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:47.110843 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20684be9-6dcc-4432-9931-b15b12cb0679 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:47.123972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20684be9-6dcc-4432-9931-b15b12cb0679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:47.123972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20684be9-6dcc-4432-9931-b15b12cb0679 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:47.123972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20684be9-6dcc-4432-9931-b15b12cb0679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:47.123972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20684be9-6dcc-4432-9931-b15b12cb0679 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:47.124386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae842d-25e4-425b-933d-9f88c106d332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:47.124386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae842d-25e4-425b-933d-9f88c106d332 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:47.124386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae842d-25e4-425b-933d-9f88c106d332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:47.124386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae842d-25e4-425b-933d-9f88c106d332 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:47.125947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae842d-25e4-425b-933d-9f88c106d332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:47.129137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae842d-25e4-425b-933d-9f88c106d332 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:47.346176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:47.359348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 729/1476] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:46 2022] POST /identity/v3/projects => generated 363 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:47.360393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 748/1477] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:46 2022] POST /identity/v3/users => generated 297 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:47.360482 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae842d-25e4-425b-933d-9f88c106d332 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:47.365924 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20684be9-6dcc-4432-9931-b15b12cb0679 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:47.388790 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20684be9-6dcc-4432-9931-b15b12cb0679 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:47.555425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40614b-0289-483e-a800-fc5c7037be75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:47.556972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40614b-0289-483e-a800-fc5c7037be75 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:47.557740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40614b-0289-483e-a800-fc5c7037be75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:47.558376 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40614b-0289-483e-a800-fc5c7037be75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:47.559878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40614b-0289-483e-a800-fc5c7037be75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:47.561975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40614b-0289-483e-a800-fc5c7037be75 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:47.577908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 749/1478] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:09:47.579529 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40614b-0289-483e-a800-fc5c7037be75 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:47.581744 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ea40614b-0289-483e-a800-fc5c7037be75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:47.583537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae842d-25e4-425b-933d-9f88c106d332 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:47.593910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9aac6-e313-40e9-b0eb-ab0d8dd439dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:47.594690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9aac6-e313-40e9-b0eb-ab0d8dd439dd admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:47.594988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9aac6-e313-40e9-b0eb-ab0d8dd439dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:47.595253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9aac6-e313-40e9-b0eb-ab0d8dd439dd admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:47.596500 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9aac6-e313-40e9-b0eb-ab0d8dd439dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:47.600057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9aac6-e313-40e9-b0eb-ab0d8dd439dd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:47.718757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 730/1479] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:47 2022] POST /identity/v3/users => generated 288 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:47.719600 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9aac6-e313-40e9-b0eb-ab0d8dd439dd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:47.738486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9aac6-e313-40e9-b0eb-ab0d8dd439dd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:47.754218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83428470-23ef-492d-b839-b1b8449dafb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:47.754652 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40614b-0289-483e-a800-fc5c7037be75 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:47.754907 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83428470-23ef-492d-b839-b1b8449dafb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:47.755190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83428470-23ef-492d-b839-b1b8449dafb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:47.755465 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83428470-23ef-492d-b839-b1b8449dafb8 admin admin] PATH_INFO: `/v3/projects/0bf6f117a8084a43bba85f916d1df2e5/users/a7c25476a63c45d6902d3f1b1db3c616/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:47.775414 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc231ee-964d-4b64-b875-2385c98d0a98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:47.776044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc231ee-964d-4b64-b875-2385c98d0a98 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:47.776321 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc231ee-964d-4b64-b875-2385c98d0a98 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:47.779379 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83428470-23ef-492d-b839-b1b8449dafb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf6f117a8084a43bba85f916d1df2e5, user_id=a7c25476a63c45d6902d3f1b1db3c616, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:47.782289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc231ee-964d-4b64-b875-2385c98d0a98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:47.783012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83428470-23ef-492d-b839-b1b8449dafb8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:47.804493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc231ee-964d-4b64-b875-2385c98d0a98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:47.806242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc231ee-964d-4b64-b875-2385c98d0a98 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:47.827724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 750/1480] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:47.828654 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc231ee-964d-4b64-b875-2385c98d0a98 service nova] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:47.842237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc231ee-964d-4b64-b875-2385c98d0a98 service nova] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:47.850626 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904153ba-6164-433d-8636-3f1b5979289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:47.851741 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904153ba-6164-433d-8636-3f1b5979289c admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:47.852023 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904153ba-6164-433d-8636-3f1b5979289c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:47.852317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904153ba-6164-433d-8636-3f1b5979289c admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:47.853078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904153ba-6164-433d-8636-3f1b5979289c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:47.855050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904153ba-6164-433d-8636-3f1b5979289c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:47.871395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 751/1482] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:47.877526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 731/1482] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:47 2022] PUT /identity/v3/projects/0bf6f117a8084a43bba85f916d1df2e5/users/a7c25476a63c45d6902d3f1b1db3c616/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:47.877849 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904153ba-6164-433d-8636-3f1b5979289c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:47.878541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83428470-23ef-492d-b839-b1b8449dafb8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:47.901865 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904153ba-6164-433d-8636-3f1b5979289c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:48.072482 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b721081-50ae-4f43-8cb0-d14653819e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:48.073171 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b721081-50ae-4f43-8cb0-d14653819e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:48.073478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b721081-50ae-4f43-8cb0-d14653819e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:48.073782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b721081-50ae-4f43-8cb0-d14653819e83 admin admin] PATH_INFO: `/v3/projects/3b3df75f826348e6be61e8aef7fffb25/users/93452a0b96c44b80bd631a80c41922e1/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:48.119577 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b721081-50ae-4f43-8cb0-d14653819e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3df75f826348e6be61e8aef7fffb25, user_id=93452a0b96c44b80bd631a80c41922e1, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:48.127842 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b721081-50ae-4f43-8cb0-d14653819e83 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:48.134121 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83428470-23ef-492d-b839-b1b8449dafb8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:48.141649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17448eb-3e82-4c63-a221-cc63b67e19c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:48.141649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17448eb-3e82-4c63-a221-cc63b67e19c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:48.141649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17448eb-3e82-4c63-a221-cc63b67e19c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:48.153767 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17448eb-3e82-4c63-a221-cc63b67e19c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:48.154684 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17448eb-3e82-4c63-a221-cc63b67e19c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:48.158293 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17448eb-3e82-4c63-a221-cc63b67e19c1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:48.176908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 732/1483] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:48.181911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17448eb-3e82-4c63-a221-cc63b67e19c1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:48.231787 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17448eb-3e82-4c63-a221-cc63b67e19c1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:48.236875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea0139-d219-4bd9-9231-eb29e24fd671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:48.238208 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea0139-d219-4bd9-9231-eb29e24fd671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:48.239102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea0139-d219-4bd9-9231-eb29e24fd671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:48.239102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea0139-d219-4bd9-9231-eb29e24fd671 admin admin] PATH_INFO: `/v3/projects/0bf6f117a8084a43bba85f916d1df2e5/users/a7c25476a63c45d6902d3f1b1db3c616/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:48.250363 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea0139-d219-4bd9-9231-eb29e24fd671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf6f117a8084a43bba85f916d1df2e5, user_id=a7c25476a63c45d6902d3f1b1db3c616, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:48.252944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea0139-d219-4bd9-9231-eb29e24fd671 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:48.280047 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 752/1484] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:47 2022] PUT /identity/v3/projects/3b3df75f826348e6be61e8aef7fffb25/users/93452a0b96c44b80bd631a80c41922e1/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:48.283335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 733/1485] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:48 2022] PUT /identity/v3/projects/0bf6f117a8084a43bba85f916d1df2e5/users/a7c25476a63c45d6902d3f1b1db3c616/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:48.284954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b721081-50ae-4f43-8cb0-d14653819e83 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:48.300266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfa093-9a8b-4a8c-8e3e-540109372d83 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:48.300572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfa093-9a8b-4a8c-8e3e-540109372d83 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:48.301161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfa093-9a8b-4a8c-8e3e-540109372d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:48.352901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5acfa093-9a8b-4a8c-8e3e-540109372d83 None None] MFA Rules not processed for user `a7c25476a63c45d6902d3f1b1db3c616`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:48.356002 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5acfa093-9a8b-4a8c-8e3e-540109372d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:48.428932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:48.453929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b721081-50ae-4f43-8cb0-d14653819e83 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:48.577735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 734/1486] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:09:48.593862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfa093-9a8b-4a8c-8e3e-540109372d83 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:48.599854 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15894fcb-be01-4e4f-955b-d42bd05927de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:48.605843 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15894fcb-be01-4e4f-955b-d42bd05927de admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:48.605843 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15894fcb-be01-4e4f-955b-d42bd05927de admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:48.605843 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15894fcb-be01-4e4f-955b-d42bd05927de admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:48.605843 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15894fcb-be01-4e4f-955b-d42bd05927de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:48.606143 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5acfa093-9a8b-4a8c-8e3e-540109372d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:48.606226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15894fcb-be01-4e4f-955b-d42bd05927de admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:48.621278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 753/1487] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:48.622238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15894fcb-be01-4e4f-955b-d42bd05927de admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:48.657878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15894fcb-be01-4e4f-955b-d42bd05927de admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:48.682958 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e91248-d47e-4401-a73c-d20bb0d04d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:48.683632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e91248-d47e-4401-a73c-d20bb0d04d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:48.683909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e91248-d47e-4401-a73c-d20bb0d04d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:48.684178 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e91248-d47e-4401-a73c-d20bb0d04d5a admin admin] PATH_INFO: `/v3/projects/3b3df75f826348e6be61e8aef7fffb25/users/93452a0b96c44b80bd631a80c41922e1/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:48.685555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfa093-9a8b-4a8c-8e3e-540109372d83 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:48.695803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e91248-d47e-4401-a73c-d20bb0d04d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b3df75f826348e6be61e8aef7fffb25, user_id=93452a0b96c44b80bd631a80c41922e1, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:48.698819 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861c79d-40ce-4552-a186-b8a71c253e3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:48.698819 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861c79d-40ce-4552-a186-b8a71c253e3b service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:48.699555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861c79d-40ce-4552-a186-b8a71c253e3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:48.699555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861c79d-40ce-4552-a186-b8a71c253e3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:48.699726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e91248-d47e-4401-a73c-d20bb0d04d5a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:48.725860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861c79d-40ce-4552-a186-b8a71c253e3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:48.729709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 754/1488] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:48 2022] PUT /identity/v3/projects/3b3df75f826348e6be61e8aef7fffb25/users/93452a0b96c44b80bd631a80c41922e1/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:48.741750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861c79d-40ce-4552-a186-b8a71c253e3b service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:48.746568 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44304b18-1be2-439b-9fef-a9f0ec21b533 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:48.746841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44304b18-1be2-439b-9fef-a9f0ec21b533 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:48.747142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44304b18-1be2-439b-9fef-a9f0ec21b533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:48.779215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 735/1489] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:09:48.832292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-44304b18-1be2-439b-9fef-a9f0ec21b533 None None] MFA Rules not processed for user `93452a0b96c44b80bd631a80c41922e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:48.832292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-44304b18-1be2-439b-9fef-a9f0ec21b533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:48.867333 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861c79d-40ce-4552-a186-b8a71c253e3b service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:48.869488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b861c79d-40ce-4552-a186-b8a71c253e3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:48.961879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861c79d-40ce-4552-a186-b8a71c253e3b service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:49.146526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 755/1490] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:09:49.160642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44304b18-1be2-439b-9fef-a9f0ec21b533 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:49.162220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-44304b18-1be2-439b-9fef-a9f0ec21b533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:49.188949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:49.192182 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c847a42-fa39-487a-98ce-ebbadb604813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:49.196096 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c847a42-fa39-487a-98ce-ebbadb604813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:49.196375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c847a42-fa39-487a-98ce-ebbadb604813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:49.197691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c847a42-fa39-487a-98ce-ebbadb604813 admin admin] PATH_INFO: `/v3/projects/6a491a4c16c5469682b11fd83983951f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:49.198312 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c847a42-fa39-487a-98ce-ebbadb604813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a491a4c16c5469682b11fd83983951f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:49.202080 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c847a42-fa39-487a-98ce-ebbadb604813 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:49.349125 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44304b18-1be2-439b-9fef-a9f0ec21b533 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:49.357872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71271b2-8118-4788-82f2-14e2417472f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:49.359751 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71271b2-8118-4788-82f2-14e2417472f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:49.360260 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71271b2-8118-4788-82f2-14e2417472f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:49.360570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71271b2-8118-4788-82f2-14e2417472f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:49.402445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71271b2-8118-4788-82f2-14e2417472f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:49.407407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71271b2-8118-4788-82f2-14e2417472f9 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:49.414322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9c847a42-fa39-487a-98ce-ebbadb604813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a491a4c16c5469682b11fd83983951f', 'request_id': 'req-9c847a42-fa39-487a-98ce-ebbadb604813'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:49.435477 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 756/1491] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:49.495903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9c847a42-fa39-487a-98ce-ebbadb604813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a491a4c16c5469682b11fd83983951f', 'request_id': 'req-9c847a42-fa39-487a-98ce-ebbadb604813'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:49.505501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9c847a42-fa39-487a-98ce-ebbadb604813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a491a4c16c5469682b11fd83983951f', 'request_id': 'req-9c847a42-fa39-487a-98ce-ebbadb604813'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:49.525459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9c847a42-fa39-487a-98ce-ebbadb604813 admin admin] The token cache is being invalidate because project 6a491a4c16c5469682b11fd83983951f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:49.525798 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9c847a42-fa39-487a-98ce-ebbadb604813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:49.526560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9c847a42-fa39-487a-98ce-ebbadb604813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:49.536641 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600bbf4-b2cb-4aa4-89c9-b1690c6f9091 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:49.536924 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600bbf4-b2cb-4aa4-89c9-b1690c6f9091 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:49.537255 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600bbf4-b2cb-4aa4-89c9-b1690c6f9091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:49.540358 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 736/1492] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:48 2022] DELETE /identity/v3/projects/6a491a4c16c5469682b11fd83983951f => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:49.577621 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-9600bbf4-b2cb-4aa4-89c9-b1690c6f9091 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:49.586872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9600bbf4-b2cb-4aa4-89c9-b1690c6f9091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:49.652196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bd66c-04bf-4f41-91fd-07f1869e0045 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:49.652552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bd66c-04bf-4f41-91fd-07f1869e0045 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:49.652829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bd66c-04bf-4f41-91fd-07f1869e0045 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:49.656241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 737/1493] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 31 15:09:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:09:49.675329 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f265acf-f9ce-48f7-87fa-6584081f2d69 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:49.676514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f265acf-f9ce-48f7-87fa-6584081f2d69 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:49.676866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f265acf-f9ce-48f7-87fa-6584081f2d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:49.692047 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 757/1494] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:49.694811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49464a57-374c-46c7-8a2d-5468349e1050 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:49.695148 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49464a57-374c-46c7-8a2d-5468349e1050 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:49.695429 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49464a57-374c-46c7-8a2d-5468349e1050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:49.736838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2f265acf-f9ce-48f7-87fa-6584081f2d69 None None] MFA Rules not processed for user `9ec30e419d6f4fddb05c4bb08f2ce3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:49.738494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2f265acf-f9ce-48f7-87fa-6584081f2d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:49.751749 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-49464a57-374c-46c7-8a2d-5468349e1050 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:49.755790 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-49464a57-374c-46c7-8a2d-5468349e1050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:49.778984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 758/1495] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:49.779986 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49464a57-374c-46c7-8a2d-5468349e1050 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:49.784163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-49464a57-374c-46c7-8a2d-5468349e1050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:49.871980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 738/1496] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 31 15:09:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:49.873344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f265acf-f9ce-48f7-87fa-6584081f2d69 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:49.887357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f265acf-f9ce-48f7-87fa-6584081f2d69 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:49.894930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c233d9-3a44-401f-9071-b3facab61aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:49.903426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c233d9-3a44-401f-9071-b3facab61aab admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:49.903426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c233d9-3a44-401f-9071-b3facab61aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:49.903426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c233d9-3a44-401f-9071-b3facab61aab admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:49.903426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c233d9-3a44-401f-9071-b3facab61aab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:49.903426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c233d9-3a44-401f-9071-b3facab61aab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:49.903426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c233d9-3a44-401f-9071-b3facab61aab admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:49.918476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 739/1497] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:49.923353 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c233d9-3a44-401f-9071-b3facab61aab admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:49.935769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c233d9-3a44-401f-9071-b3facab61aab admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:49.942219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7615c-0faf-4a36-b8e2-1b81a0af10b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:49.943762 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7615c-0faf-4a36-b8e2-1b81a0af10b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:49.944170 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49464a57-374c-46c7-8a2d-5468349e1050 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:49.944376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7615c-0faf-4a36-b8e2-1b81a0af10b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:49.944894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7615c-0faf-4a36-b8e2-1b81a0af10b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:49.945795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7615c-0faf-4a36-b8e2-1b81a0af10b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:49.947939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7615c-0faf-4a36-b8e2-1b81a0af10b7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:49.949510 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c5500-23f2-426b-a41f-51b9d5f7feb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:49.950212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c5500-23f2-426b-a41f-51b9d5f7feb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:49.950800 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c5500-23f2-426b-a41f-51b9d5f7feb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:49.951140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c5500-23f2-426b-a41f-51b9d5f7feb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:49.954056 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0a7c5500-23f2-426b-a41f-51b9d5f7feb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:50.074257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 740/1498] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:49 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:50.075127 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7615c-0faf-4a36-b8e2-1b81a0af10b7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:50.079640 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7cc7615c-0faf-4a36-b8e2-1b81a0af10b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:50.099446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c5500-23f2-426b-a41f-51b9d5f7feb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:50.101030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c5500-23f2-426b-a41f-51b9d5f7feb9 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:50.118740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 759/1499] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:50.119918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c5500-23f2-426b-a41f-51b9d5f7feb9 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:50.147368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c5500-23f2-426b-a41f-51b9d5f7feb9 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:50.255361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7615c-0faf-4a36-b8e2-1b81a0af10b7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:50.277501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979bd16-b987-4102-bca7-02acf27fe8e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:50.279001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979bd16-b987-4102-bca7-02acf27fe8e8 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:50.279291 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979bd16-b987-4102-bca7-02acf27fe8e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:50.279571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979bd16-b987-4102-bca7-02acf27fe8e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:50.302833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979bd16-b987-4102-bca7-02acf27fe8e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:50.303032 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a4a8d-34e7-4080-bba8-d077ebdd3108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:50.303726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4a8d-34e7-4080-bba8-d077ebdd3108 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:50.304042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4a8d-34e7-4080-bba8-d077ebdd3108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:50.304282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4a8d-34e7-4080-bba8-d077ebdd3108 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:50.304953 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a4a8d-34e7-4080-bba8-d077ebdd3108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:50.305310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979bd16-b987-4102-bca7-02acf27fe8e8 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:50.307271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a4a8d-34e7-4080-bba8-d077ebdd3108 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:50.321136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 741/1500] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:50.449248 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979bd16-b987-4102-bca7-02acf27fe8e8 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:50.459363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 760/1501] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:50 2022] POST /identity/v3/users => generated 286 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:50.472688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979bd16-b987-4102-bca7-02acf27fe8e8 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:50.507783 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6a659-9ad6-4a35-a64b-d8f2fca8536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:50.508417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6a659-9ad6-4a35-a64b-d8f2fca8536c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:50.508722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6a659-9ad6-4a35-a64b-d8f2fca8536c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:50.509233 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6a659-9ad6-4a35-a64b-d8f2fca8536c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:50.512250 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6a659-9ad6-4a35-a64b-d8f2fca8536c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:50.512250 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6a659-9ad6-4a35-a64b-d8f2fca8536c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:50.542311 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 742/1502] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:50.542847 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a4a8d-34e7-4080-bba8-d077ebdd3108 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:50.560043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a4a8d-34e7-4080-bba8-d077ebdd3108 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:50.566441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6a659-9ad6-4a35-a64b-d8f2fca8536c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:50.579906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6cd6a659-9ad6-4a35-a64b-d8f2fca8536c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:50.593009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a9d72-07db-4c44-b38b-9647d172212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:50.594078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a9d72-07db-4c44-b38b-9647d172212c admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:50.594559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a9d72-07db-4c44-b38b-9647d172212c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:50.599798 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a9d72-07db-4c44-b38b-9647d172212c admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:50.600790 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a9d72-07db-4c44-b38b-9647d172212c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:50.604178 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a9d72-07db-4c44-b38b-9647d172212c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:50.618086 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 761/1503] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:50.622555 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a9d72-07db-4c44-b38b-9647d172212c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:50.637083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:50.642323 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a9d72-07db-4c44-b38b-9647d172212c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:50.647763 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d40728-db48-4414-a2a6-3eae22a21501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:50.649225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40728-db48-4414-a2a6-3eae22a21501 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:50.649608 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40728-db48-4414-a2a6-3eae22a21501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:50.649816 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40728-db48-4414-a2a6-3eae22a21501 admin admin] PATH_INFO: `/v3/projects/1a4a9bd0509b4d279b48feb54f56387f/users/d5801f8d4fa14735a78d2639b36615c0/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:50.673377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d40728-db48-4414-a2a6-3eae22a21501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a4a9bd0509b4d279b48feb54f56387f, user_id=d5801f8d4fa14735a78d2639b36615c0, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:50.689370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d40728-db48-4414-a2a6-3eae22a21501 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:50.703428 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6a659-9ad6-4a35-a64b-d8f2fca8536c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:50.709438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab95fea-b8e9-4a89-94dc-ae5a10873716 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c25476a63c45d6902d3f1b1db3c616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf6f117a8084a43bba85f916d1df2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:50.710295 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab95fea-b8e9-4a89-94dc-ae5a10873716 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:50.710657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab95fea-b8e9-4a89-94dc-ae5a10873716 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:50.711006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab95fea-b8e9-4a89-94dc-ae5a10873716 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:50.711810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab95fea-b8e9-4a89-94dc-ae5a10873716 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:50.712196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab95fea-b8e9-4a89-94dc-ae5a10873716 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:50.714560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab95fea-b8e9-4a89-94dc-ae5a10873716 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:50.796832 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 743/1504] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:50.813569 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab95fea-b8e9-4a89-94dc-ae5a10873716 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:50.825905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 762/1505] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:50 2022] PUT /identity/v3/projects/1a4a9bd0509b4d279b48feb54f56387f/users/d5801f8d4fa14735a78d2639b36615c0/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:50.843657 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90618f-4a9b-4c46-a6ca-2b32c9d5f0a9 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:50.844064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90618f-4a9b-4c46-a6ca-2b32c9d5f0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:50.844455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90618f-4a9b-4c46-a6ca-2b32c9d5f0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:50.846136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab95fea-b8e9-4a89-94dc-ae5a10873716 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:50.901944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-6b90618f-4a9b-4c46-a6ca-2b32c9d5f0a9 None None] MFA Rules not processed for user `d5801f8d4fa14735a78d2639b36615c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:50.903411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6b90618f-4a9b-4c46-a6ca-2b32c9d5f0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:51.050795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056960f-2b99-42df-bf3b-d81418ccf2e7 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c25476a63c45d6902d3f1b1db3c616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf6f117a8084a43bba85f916d1df2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:51.051634 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056960f-2b99-42df-bf3b-d81418ccf2e7 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:51.051961 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056960f-2b99-42df-bf3b-d81418ccf2e7 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:51.061204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056960f-2b99-42df-bf3b-d81418ccf2e7 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:51.066155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056960f-2b99-42df-bf3b-d81418ccf2e7 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:51.068220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056960f-2b99-42df-bf3b-d81418ccf2e7 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:51.137159 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 763/1506] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:51.152404 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90618f-4a9b-4c46-a6ca-2b32c9d5f0a9 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:51.244057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 744/1507] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:50 2022] POST /identity/v3/projects => generated 355 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:51.247819 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056960f-2b99-42df-bf3b-d81418ccf2e7 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:51.262741 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90618f-4a9b-4c46-a6ca-2b32c9d5f0a9 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:51.331390 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d32508-39b3-4fea-815b-93357e4c0943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:51.332639 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d32508-39b3-4fea-815b-93357e4c0943 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:51.333196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d32508-39b3-4fea-815b-93357e4c0943 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:51.333768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d32508-39b3-4fea-815b-93357e4c0943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:51.440249 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d32508-39b3-4fea-815b-93357e4c0943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:51.442888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d32508-39b3-4fea-815b-93357e4c0943 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:51.459898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 764/1508] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:09:51.490526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d32508-39b3-4fea-815b-93357e4c0943 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:51.506488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056960f-2b99-42df-bf3b-d81418ccf2e7 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:51.513703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300d666-bb1e-4d0f-8fbb-26976ab3eaf5 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c25476a63c45d6902d3f1b1db3c616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf6f117a8084a43bba85f916d1df2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:51.515509 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300d666-bb1e-4d0f-8fbb-26976ab3eaf5 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:51.516720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300d666-bb1e-4d0f-8fbb-26976ab3eaf5 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:51.517568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300d666-bb1e-4d0f-8fbb-26976ab3eaf5 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:51.518416 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300d666-bb1e-4d0f-8fbb-26976ab3eaf5 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:51.518981 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300d666-bb1e-4d0f-8fbb-26976ab3eaf5 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:51.521232 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300d666-bb1e-4d0f-8fbb-26976ab3eaf5 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:51.540608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 745/1509] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:51.581769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:51.606686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300d666-bb1e-4d0f-8fbb-26976ab3eaf5 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:51.633253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300d666-bb1e-4d0f-8fbb-26976ab3eaf5 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:51.643633 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a5ba7-71e0-468c-aac1-071032820b44 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7c25476a63c45d6902d3f1b1db3c616', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bf6f117a8084a43bba85f916d1df2e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:51.644631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5ba7-71e0-468c-aac1-071032820b44 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:51.645679 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5ba7-71e0-468c-aac1-071032820b44 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:51.646203 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a5ba7-71e0-468c-aac1-071032820b44 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] PATH_INFO: `/v3/projects/2a0afe5e70e74e76adaa6323b44ca5ca` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:51.647924 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a5ba7-71e0-468c-aac1-071032820b44 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2a0afe5e70e74e76adaa6323b44ca5ca)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:51.653506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a5ba7-71e0-468c-aac1-071032820b44 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:51.656113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d32508-39b3-4fea-815b-93357e4c0943 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:51.661628 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:51.662273 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:51.672968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:51.673270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] PATH_INFO: `/v3/users/d5801f8d4fa14735a78d2639b36615c0` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:51.675059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5801f8d4fa14735a78d2639b36615c0)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:51.678873 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:51.823360 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-603a5ba7-71e0-468c-aac1-071032820b44 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0afe5e70e74e76adaa6323b44ca5ca', 'request_id': 'req-603a5ba7-71e0-468c-aac1-071032820b44'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:51.953228 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-603a5ba7-71e0-468c-aac1-071032820b44 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0afe5e70e74e76adaa6323b44ca5ca', 'request_id': 'req-603a5ba7-71e0-468c-aac1-071032820b44'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:51.963403 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-603a5ba7-71e0-468c-aac1-071032820b44 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0afe5e70e74e76adaa6323b44ca5ca', 'request_id': 'req-603a5ba7-71e0-468c-aac1-071032820b44'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:51.988469 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5801f8d4fa14735a78d2639b36615c0'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:51.990288 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5801f8d4fa14735a78d2639b36615c0'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:52.008534 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5801f8d4fa14735a78d2639b36615c0'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:52.008839 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5801f8d4fa14735a78d2639b36615c0'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:52.015230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-603a5ba7-71e0-468c-aac1-071032820b44 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] The token cache is being invalidate because project 2a0afe5e70e74e76adaa6323b44ca5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:52.015584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-603a5ba7-71e0-468c-aac1-071032820b44 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:52.016423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-603a5ba7-71e0-468c-aac1-071032820b44 tempest-VolumeQuotaClassesTest-1199402362 tempest-VolumeQuotaClassesTest-1199402362-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:52.026139 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 746/1510] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:51 2022] DELETE /identity/v3/projects/2a0afe5e70e74e76adaa6323b44ca5ca => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:52.111889 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5801f8d4fa14735a78d2639b36615c0'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:52.153160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 765/1511] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:51 2022] DELETE /identity/v3/users/d5801f8d4fa14735a78d2639b36615c0 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:52.158675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f41de-853a-4ace-8c87-4dd41f081620 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:52.159034 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f41de-853a-4ace-8c87-4dd41f081620 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:52.159408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f41de-853a-4ace-8c87-4dd41f081620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:52.219266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2a1f41de-853a-4ace-8c87-4dd41f081620 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:52.222475 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2a1f41de-853a-4ace-8c87-4dd41f081620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:52.389828 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 747/1512] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:52.431754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:52.433269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:52.527314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba086959-6e4f-4590-bc73-bbcbc3fef668 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:52.548300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952468d-0de4-4cfa-b1ac-ce4318c11e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:52.549705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952468d-0de4-4cfa-b1ac-ce4318c11e7b service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:52.550695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952468d-0de4-4cfa-b1ac-ce4318c11e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:52.550695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952468d-0de4-4cfa-b1ac-ce4318c11e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:52.563946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952468d-0de4-4cfa-b1ac-ce4318c11e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:52.566014 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952468d-0de4-4cfa-b1ac-ce4318c11e7b service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:52.586899 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 766/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:09:52.922595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f41de-853a-4ace-8c87-4dd41f081620 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:52.924183 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2a1f41de-853a-4ace-8c87-4dd41f081620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:52.947514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f41de-853a-4ace-8c87-4dd41f081620 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:52.957660 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:52.958510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:52.961704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:52.961704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] PATH_INFO: `/v3/users/f1cad016d47d4dfdaec93e702e1254e3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:52.961704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1cad016d47d4dfdaec93e702e1254e3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:52.962750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:53.388670 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1cad016d47d4dfdaec93e702e1254e3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:53.391542 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1cad016d47d4dfdaec93e702e1254e3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:53.403695 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1cad016d47d4dfdaec93e702e1254e3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:53.536252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1cad016d47d4dfdaec93e702e1254e3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:53.556037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1cad016d47d4dfdaec93e702e1254e3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:53.579563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 748/1514] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:52 2022] DELETE /identity/v3/users/f1cad016d47d4dfdaec93e702e1254e3 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:53.580010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d80296-4f64-429a-97ff-1d599e17cb05 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:53.580592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d80296-4f64-429a-97ff-1d599e17cb05 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:53.580901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d80296-4f64-429a-97ff-1d599e17cb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:53.624254 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-99d80296-4f64-429a-97ff-1d599e17cb05 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:53.630443 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-99d80296-4f64-429a-97ff-1d599e17cb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:53.753659 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 767/1515] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:09:53.823015 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:53.825473 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:53.986529 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62a80f-88fd-4a00-86ac-039a0824163c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:53.998060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4be541-dc8f-403a-a03d-6f1ab1b9b70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:53.999113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4be541-dc8f-403a-a03d-6f1ab1b9b70f service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:54.009176 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4be541-dc8f-403a-a03d-6f1ab1b9b70f service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:54.009176 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4be541-dc8f-403a-a03d-6f1ab1b9b70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:54.020601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4be541-dc8f-403a-a03d-6f1ab1b9b70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:54.022520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4be541-dc8f-403a-a03d-6f1ab1b9b70f service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:54.035546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 749/1516] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:54.296006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:54.774224 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d80296-4f64-429a-97ff-1d599e17cb05 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:54.775931 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-99d80296-4f64-429a-97ff-1d599e17cb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:54.794856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d80296-4f64-429a-97ff-1d599e17cb05 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:54.810033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966da61c-926e-4f41-b330-dbc827f1a488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:54.814285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da61c-926e-4f41-b330-dbc827f1a488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:54.814285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da61c-926e-4f41-b330-dbc827f1a488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:54.814285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da61c-926e-4f41-b330-dbc827f1a488 admin admin] PATH_INFO: `/v3/projects/1a4a9bd0509b4d279b48feb54f56387f` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:54.815380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966da61c-926e-4f41-b330-dbc827f1a488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a4a9bd0509b4d279b48feb54f56387f)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:54.817567 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966da61c-926e-4f41-b330-dbc827f1a488 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:54.937647 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:55.025205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-966da61c-926e-4f41-b330-dbc827f1a488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a4a9bd0509b4d279b48feb54f56387f', 'request_id': 'req-966da61c-926e-4f41-b330-dbc827f1a488'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:55.156706 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-966da61c-926e-4f41-b330-dbc827f1a488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a4a9bd0509b4d279b48feb54f56387f', 'request_id': 'req-966da61c-926e-4f41-b330-dbc827f1a488'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:55.166850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-966da61c-926e-4f41-b330-dbc827f1a488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a4a9bd0509b4d279b48feb54f56387f', 'request_id': 'req-966da61c-926e-4f41-b330-dbc827f1a488'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:55.181854 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-966da61c-926e-4f41-b330-dbc827f1a488 admin admin] The token cache is being invalidate because project 1a4a9bd0509b4d279b48feb54f56387f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:55.182534 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-966da61c-926e-4f41-b330-dbc827f1a488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:55.183577 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-966da61c-926e-4f41-b330-dbc827f1a488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:55.186100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 768/1517] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:54 2022] DELETE /identity/v3/projects/1a4a9bd0509b4d279b48feb54f56387f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:55.192135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45135f56-75eb-4168-8297-1210c7a3f2e4 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:55.193894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45135f56-75eb-4168-8297-1210c7a3f2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:55.194555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45135f56-75eb-4168-8297-1210c7a3f2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.231177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-45135f56-75eb-4168-8297-1210c7a3f2e4 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:55.232952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-45135f56-75eb-4168-8297-1210c7a3f2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:55.380980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 750/1518] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:55.391603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b1032-fe48-4eef-b38a-2f013f476551 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:55.392730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b1032-fe48-4eef-b38a-2f013f476551 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:55.393169 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b1032-fe48-4eef-b38a-2f013f476551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.423457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d81b1032-fe48-4eef-b38a-2f013f476551 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:55.425675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d81b1032-fe48-4eef-b38a-2f013f476551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:55.438359 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 769/1519] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:55.448906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45135f56-75eb-4168-8297-1210c7a3f2e4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:55.469042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45135f56-75eb-4168-8297-1210c7a3f2e4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:55.486049 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81538f20-4453-45bc-811f-4b5f15712da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:55.486922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81538f20-4453-45bc-811f-4b5f15712da3 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:55.487359 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81538f20-4453-45bc-811f-4b5f15712da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:55.487833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81538f20-4453-45bc-811f-4b5f15712da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.488748 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81538f20-4453-45bc-811f-4b5f15712da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:55.489261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81538f20-4453-45bc-811f-4b5f15712da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:55.493855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81538f20-4453-45bc-811f-4b5f15712da3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:55.529119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b1032-fe48-4eef-b38a-2f013f476551 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:55.539184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 751/1520] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:09:55.540626 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b1032-fe48-4eef-b38a-2f013f476551 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:55.546921 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe2c64-6330-4bff-9c24-07e6693ac675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:55.547920 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2c64-6330-4bff-9c24-07e6693ac675 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:55.548302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2c64-6330-4bff-9c24-07e6693ac675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:55.548691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe2c64-6330-4bff-9c24-07e6693ac675 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.549697 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe2c64-6330-4bff-9c24-07e6693ac675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:55.552042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe2c64-6330-4bff-9c24-07e6693ac675 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:55.763737 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81538f20-4453-45bc-811f-4b5f15712da3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:55.769738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 770/1521] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:55 2022] POST /identity/v3/projects => generated 369 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:55.776046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81538f20-4453-45bc-811f-4b5f15712da3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:55.801543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe2c64-6330-4bff-9c24-07e6693ac675 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:55.803566 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5afe2c64-6330-4bff-9c24-07e6693ac675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:55.950629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099c9b4-6b6f-4e32-ab37-a9a83e2c29af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:55.951357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099c9b4-6b6f-4e32-ab37-a9a83e2c29af admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:55.952266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099c9b4-6b6f-4e32-ab37-a9a83e2c29af admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:55.952612 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099c9b4-6b6f-4e32-ab37-a9a83e2c29af admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.958104 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099c9b4-6b6f-4e32-ab37-a9a83e2c29af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:55.961627 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099c9b4-6b6f-4e32-ab37-a9a83e2c29af admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:55.968822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe2c64-6330-4bff-9c24-07e6693ac675 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:55.989772 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:55.993396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:55.993396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:55.993582 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] PATH_INFO: `/v3/projects/c614c6d803f545f0bea7109359d2f74d` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:55.995666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c614c6d803f545f0bea7109359d2f74d)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:56.002586 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:56.106372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 752/1522] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:55 2022] POST /identity/v3/users => generated 285 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:09:56.107417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099c9b4-6b6f-4e32-ab37-a9a83e2c29af admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:56.119048 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099c9b4-6b6f-4e32-ab37-a9a83e2c29af admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:56.127873 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35a086-ff71-40e4-942c-2b704339d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:56.128557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35a086-ff71-40e4-942c-2b704339d943 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:56.128838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35a086-ff71-40e4-942c-2b704339d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:56.129547 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35a086-ff71-40e4-942c-2b704339d943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:56.130128 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35a086-ff71-40e4-942c-2b704339d943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:56.134318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35a086-ff71-40e4-942c-2b704339d943 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:56.146131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 753/1523] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:09:56.150130 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35a086-ff71-40e4-942c-2b704339d943 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:56.166666 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35a086-ff71-40e4-942c-2b704339d943 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:56.171510 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c614c6d803f545f0bea7109359d2f74d', 'request_id': 'req-f07b7358-0630-42ee-9e61-1908051049dd'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:56.234473 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f14fc2-da27-4627-8745-e899a51b5722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:56.235094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14fc2-da27-4627-8745-e899a51b5722 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:56.235372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14fc2-da27-4627-8745-e899a51b5722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:56.235648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14fc2-da27-4627-8745-e899a51b5722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:56.236296 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f14fc2-da27-4627-8745-e899a51b5722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:56.237963 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f14fc2-da27-4627-8745-e899a51b5722 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:56.247952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 754/1524] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:56.252879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f14fc2-da27-4627-8745-e899a51b5722 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:56.263024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f14fc2-da27-4627-8745-e899a51b5722 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:56.266780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c614c6d803f545f0bea7109359d2f74d', 'request_id': 'req-f07b7358-0630-42ee-9e61-1908051049dd'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:56.273822 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796ffcb-2cfc-4658-bb4d-6fe758d24616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:56.273822 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ffcb-2cfc-4658-bb4d-6fe758d24616 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:56.273822 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ffcb-2cfc-4658-bb4d-6fe758d24616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:56.273822 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ffcb-2cfc-4658-bb4d-6fe758d24616 admin admin] PATH_INFO: `/v3/projects/cbe91bcc191a4107aac9797e362f1e3e/users/e86a6b4a59e14827ae5dc9779dd94b7b/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:56.274562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c614c6d803f545f0bea7109359d2f74d', 'request_id': 'req-f07b7358-0630-42ee-9e61-1908051049dd'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:56.285718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796ffcb-2cfc-4658-bb4d-6fe758d24616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe91bcc191a4107aac9797e362f1e3e, user_id=e86a6b4a59e14827ae5dc9779dd94b7b, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:56.286086 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] The token cache is being invalidate because project c614c6d803f545f0bea7109359d2f74d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:56.286374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:56.287015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:56.288442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796ffcb-2cfc-4658-bb4d-6fe758d24616 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:56.288780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 771/1525] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:55 2022] DELETE /identity/v3/projects/c614c6d803f545f0bea7109359d2f74d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:09:56.292436 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:56.293783 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:56.307033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b7358-0630-42ee-9e61-1908051049dd admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:56.313879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc89fd8-6c36-42d6-9a44-f51d6c3364b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:56.313879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc89fd8-6c36-42d6-9a44-f51d6c3364b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:56.313879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc89fd8-6c36-42d6-9a44-f51d6c3364b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:56.313879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc89fd8-6c36-42d6-9a44-f51d6c3364b4 admin admin] PATH_INFO: `/v3/users/a7c25476a63c45d6902d3f1b1db3c616` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:56.314517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc89fd8-6c36-42d6-9a44-f51d6c3364b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c25476a63c45d6902d3f1b1db3c616)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:56.316411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc89fd8-6c36-42d6-9a44-f51d6c3364b4 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:56.382413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 755/1526] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:56 2022] PUT /identity/v3/projects/cbe91bcc191a4107aac9797e362f1e3e/users/e86a6b4a59e14827ae5dc9779dd94b7b/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:09:56.393419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6ae19-372d-4340-b037-3a1123e63e12 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:56.393705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6ae19-372d-4340-b037-3a1123e63e12 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:56.393980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6ae19-372d-4340-b037-3a1123e63e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:56.424200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-eea6ae19-372d-4340-b037-3a1123e63e12 None None] MFA Rules not processed for user `e86a6b4a59e14827ae5dc9779dd94b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:56.425481 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-eea6ae19-372d-4340-b037-3a1123e63e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:56.491267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 756/1527] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:09:56.502966 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6ae19-372d-4340-b037-3a1123e63e12 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:56.504349 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-eea6ae19-372d-4340-b037-3a1123e63e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:56.523486 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cbc89fd8-6c36-42d6-9a44-f51d6c3364b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c25476a63c45d6902d3f1b1db3c616'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:56.524139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cbc89fd8-6c36-42d6-9a44-f51d6c3364b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c25476a63c45d6902d3f1b1db3c616'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:56.537446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cbc89fd8-6c36-42d6-9a44-f51d6c3364b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c25476a63c45d6902d3f1b1db3c616'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:56.538283 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cbc89fd8-6c36-42d6-9a44-f51d6c3364b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c25476a63c45d6902d3f1b1db3c616'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:56.587350 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6ae19-372d-4340-b037-3a1123e63e12 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:56.591215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d15c6-474e-4819-8000-b46dd320ea99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74317ae6b47843de85d03f3a9d3a811d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:56.591826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d15c6-474e-4819-8000-b46dd320ea99 service glance] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:56.592642 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d15c6-474e-4819-8000-b46dd320ea99 service glance] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:56.593025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d15c6-474e-4819-8000-b46dd320ea99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:56.595017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ec7d15c6-474e-4819-8000-b46dd320ea99 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:56.606442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d15c6-474e-4819-8000-b46dd320ea99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:56.608614 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d15c6-474e-4819-8000-b46dd320ea99 service glance] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:56.618408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 757/1528] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:56.643877 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cbc89fd8-6c36-42d6-9a44-f51d6c3364b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c25476a63c45d6902d3f1b1db3c616'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:56.658996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 772/1529] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:09:56 2022] DELETE /identity/v3/users/a7c25476a63c45d6902d3f1b1db3c616 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:09:56.949450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:57.169883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:57.334154 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d15c6-474e-4819-8000-b46dd320ea99 service glance] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:57.335735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ec7d15c6-474e-4819-8000-b46dd320ea99 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:57.431717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d15c6-474e-4819-8000-b46dd320ea99 service glance] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:57.491520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4d5f9-b633-496b-a47a-1660be85adf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:57.492332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d5f9-b633-496b-a47a-1660be85adf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:57.492618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d5f9-b633-496b-a47a-1660be85adf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:57.492893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d5f9-b633-496b-a47a-1660be85adf9 admin admin] PATH_INFO: `/v3/projects/0bf6f117a8084a43bba85f916d1df2e5` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:57.494499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4d5f9-b633-496b-a47a-1660be85adf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf6f117a8084a43bba85f916d1df2e5)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:57.496394 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4d5f9-b633-496b-a47a-1660be85adf9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:57.664234 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-cda4d5f9-b633-496b-a47a-1660be85adf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf6f117a8084a43bba85f916d1df2e5', 'request_id': 'req-cda4d5f9-b633-496b-a47a-1660be85adf9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:57.781667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-cda4d5f9-b633-496b-a47a-1660be85adf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf6f117a8084a43bba85f916d1df2e5', 'request_id': 'req-cda4d5f9-b633-496b-a47a-1660be85adf9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:57.789101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-cda4d5f9-b633-496b-a47a-1660be85adf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf6f117a8084a43bba85f916d1df2e5', 'request_id': 'req-cda4d5f9-b633-496b-a47a-1660be85adf9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:57.805830 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-cda4d5f9-b633-496b-a47a-1660be85adf9 admin admin] The token cache is being invalidate because project 0bf6f117a8084a43bba85f916d1df2e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:09:57.806268 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-cda4d5f9-b633-496b-a47a-1660be85adf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:57.807016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-cda4d5f9-b633-496b-a47a-1660be85adf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:09:57.809006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 758/1530] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:09:57 2022] DELETE /identity/v3/projects/0bf6f117a8084a43bba85f916d1df2e5 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:57.814468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7af9a-243c-4128-82c3-49cdf62008b5 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:57.814855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7af9a-243c-4128-82c3-49cdf62008b5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:57.815141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7af9a-243c-4128-82c3-49cdf62008b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:57.843999 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d9f7af9a-243c-4128-82c3-49cdf62008b5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:57.846109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d9f7af9a-243c-4128-82c3-49cdf62008b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:57.932684 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 773/1531] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:57.935606 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0764c73-a263-46ca-8ba3-013cd7feef56 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:57.936230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0764c73-a263-46ca-8ba3-013cd7feef56 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:57.936832 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0764c73-a263-46ca-8ba3-013cd7feef56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:57.968736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b0764c73-a263-46ca-8ba3-013cd7feef56 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:57.971128 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b0764c73-a263-46ca-8ba3-013cd7feef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:57.985109 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 759/1532] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:57.988186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7af9a-243c-4128-82c3-49cdf62008b5 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:58.000182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7af9a-243c-4128-82c3-49cdf62008b5 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:58.005777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e578de-4e6f-4b3d-b709-933c84af59d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:58.006572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e578de-4e6f-4b3d-b709-933c84af59d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:58.006865 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e578de-4e6f-4b3d-b709-933c84af59d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:58.007140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e578de-4e6f-4b3d-b709-933c84af59d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:58.007858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e578de-4e6f-4b3d-b709-933c84af59d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:09:58.008421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e578de-4e6f-4b3d-b709-933c84af59d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:58.010152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e578de-4e6f-4b3d-b709-933c84af59d2 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:58.031970 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 774/1533] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:09:58.036339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0764c73-a263-46ca-8ba3-013cd7feef56 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:58.046579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0764c73-a263-46ca-8ba3-013cd7feef56 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:58.054224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1e35f-8400-4b89-b3bc-cd256931083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:58.054224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1e35f-8400-4b89-b3bc-cd256931083c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:58.054224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1e35f-8400-4b89-b3bc-cd256931083c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:58.054224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1e35f-8400-4b89-b3bc-cd256931083c admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:58.063760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1e35f-8400-4b89-b3bc-cd256931083c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:58.063760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1e35f-8400-4b89-b3bc-cd256931083c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:58.199921 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 760/1534] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:09:58 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:58.204437 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e578de-4e6f-4b3d-b709-933c84af59d2 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:58.214711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e578de-4e6f-4b3d-b709-933c84af59d2 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:58.281481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f7bd8-8636-4c74-8ff2-382e8727b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:58.282221 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f7bd8-8636-4c74-8ff2-382e8727b13a admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:58.282684 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f7bd8-8636-4c74-8ff2-382e8727b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:58.283083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f7bd8-8636-4c74-8ff2-382e8727b13a admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:58.283779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f7bd8-8636-4c74-8ff2-382e8727b13a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:58.285822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f7bd8-8636-4c74-8ff2-382e8727b13a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:58.437762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 775/1535] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:09:58 2022] POST /identity/v3/users => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:09:58.439088 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1e35f-8400-4b89-b3bc-cd256931083c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:58.450415 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1e35f-8400-4b89-b3bc-cd256931083c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:58.455758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d352a-241c-4cdd-ab10-0df154927e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:58.456376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d352a-241c-4cdd-ab10-0df154927e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:58.456654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d352a-241c-4cdd-ab10-0df154927e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:58.457100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d352a-241c-4cdd-ab10-0df154927e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:58.466061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d352a-241c-4cdd-ab10-0df154927e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:58.466061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d352a-241c-4cdd-ab10-0df154927e2a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:58.475060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 761/1536] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:58.487249 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f7bd8-8636-4c74-8ff2-382e8727b13a admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:58.500146 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f7bd8-8636-4c74-8ff2-382e8727b13a admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:58.505330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ef9da-e17e-4153-9937-6f251cc5a47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:58.506525 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ef9da-e17e-4153-9937-6f251cc5a47b admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:58.506883 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ef9da-e17e-4153-9937-6f251cc5a47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:58.507117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ef9da-e17e-4153-9937-6f251cc5a47b admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:58.507827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ef9da-e17e-4153-9937-6f251cc5a47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:58.528929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ef9da-e17e-4153-9937-6f251cc5a47b admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:58.539872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 776/1537] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:09:58.542516 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d352a-241c-4cdd-ab10-0df154927e2a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:58.554157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d352a-241c-4cdd-ab10-0df154927e2a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:58.558925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c15252-9714-4f04-9de4-88bfe0f86863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:58.562875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c15252-9714-4f04-9de4-88bfe0f86863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:58.562875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c15252-9714-4f04-9de4-88bfe0f86863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:58.562875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c15252-9714-4f04-9de4-88bfe0f86863 admin admin] PATH_INFO: `/v3/projects/6987d433c13744f186c4109233f19e18/users/0b23194584cc4908b044da3e1e499c75/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:58.578101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c15252-9714-4f04-9de4-88bfe0f86863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6987d433c13744f186c4109233f19e18, user_id=0b23194584cc4908b044da3e1e499c75, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:58.581182 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c15252-9714-4f04-9de4-88bfe0f86863 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:58.672530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 762/1538] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:09:58 2022] PUT /identity/v3/projects/6987d433c13744f186c4109233f19e18/users/0b23194584cc4908b044da3e1e499c75/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:09:58.684156 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0ddc-905f-4b4f-9d02-ffc414193325 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:58.684466 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0ddc-905f-4b4f-9d02-ffc414193325 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:58.684804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca0ddc-905f-4b4f-9d02-ffc414193325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:58.714161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-bfca0ddc-905f-4b4f-9d02-ffc414193325 None None] MFA Rules not processed for user `0b23194584cc4908b044da3e1e499c75`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:09:58.715410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-bfca0ddc-905f-4b4f-9d02-ffc414193325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:58.792077 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 777/1539] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:09:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:09:58.805078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c15252-9714-4f04-9de4-88bfe0f86863 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:09:58.806879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-58c15252-9714-4f04-9de4-88bfe0f86863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:09:58.866269 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c15252-9714-4f04-9de4-88bfe0f86863 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:09:58.870362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76429f-82c9-4844-8571-ab74cfb0892a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74317ae6b47843de85d03f3a9d3a811d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:09:58.871012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76429f-82c9-4844-8571-ab74cfb0892a service glance] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:09:58.871293 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76429f-82c9-4844-8571-ab74cfb0892a service glance] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:09:58.871604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76429f-82c9-4844-8571-ab74cfb0892a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:09:58.881216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76429f-82c9-4844-8571-ab74cfb0892a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:09:58.882761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76429f-82c9-4844-8571-ab74cfb0892a service glance] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:09:58.892116 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 763/1540] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:09:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:09:59.844200 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:00.193030 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:01.123970 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:02.242898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca0ddc-905f-4b4f-9d02-ffc414193325 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:02.244403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-bfca0ddc-905f-4b4f-9d02-ffc414193325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:02.331421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca0ddc-905f-4b4f-9d02-ffc414193325 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:02.336413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:02.337048 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:02.337354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:02.337705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] PATH_INFO: `/v3/users/c180534328ea41c39ae13b860ecdf974` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:02.341457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c180534328ea41c39ae13b860ecdf974)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:02.341457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:02.531835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c180534328ea41c39ae13b860ecdf974'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.532509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c180534328ea41c39ae13b860ecdf974'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.544376 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c180534328ea41c39ae13b860ecdf974'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.545078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c180534328ea41c39ae13b860ecdf974'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.621206 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c180534328ea41c39ae13b860ecdf974'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:02.635408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 778/1541] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:02 2022] DELETE /identity/v3/users/c180534328ea41c39ae13b860ecdf974 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:02.640715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340a7e-ff31-4bc2-8fa0-daeb4e55ca69 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:02.641203 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340a7e-ff31-4bc2-8fa0-daeb4e55ca69 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:02.641203 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340a7e-ff31-4bc2-8fa0-daeb4e55ca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:02.660812 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c9340a7e-ff31-4bc2-8fa0-daeb4e55ca69 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:02.662061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c9340a7e-ff31-4bc2-8fa0-daeb4e55ca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:02.722636 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 764/1542] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:02.732520 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:02.734021 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:02.791282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d035cf-279f-49da-9348-5adfa978ef2e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:02.794893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd163f9c-c28d-4e8b-ac8f-04bbe5ea2392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:02.796189 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd163f9c-c28d-4e8b-ac8f-04bbe5ea2392 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:02.796478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd163f9c-c28d-4e8b-ac8f-04bbe5ea2392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:02.796779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd163f9c-c28d-4e8b-ac8f-04bbe5ea2392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:02.805916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd163f9c-c28d-4e8b-ac8f-04bbe5ea2392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:02.807331 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd163f9c-c28d-4e8b-ac8f-04bbe5ea2392 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:02.817998 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 779/1543] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:03.090999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:03.240882 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9340a7e-ff31-4bc2-8fa0-daeb4e55ca69 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:03.242515 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c9340a7e-ff31-4bc2-8fa0-daeb4e55ca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:03.263114 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9340a7e-ff31-4bc2-8fa0-daeb4e55ca69 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:03.273759 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:03.274376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:03.274655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:03.274928 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] PATH_INFO: `/v3/projects/a7e646ea53b14d118f9117713465c499` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:03.276290 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e646ea53b14d118f9117713465c499)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:03.278217 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:03.391686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:03.394992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e646ea53b14d118f9117713465c499', 'request_id': 'req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.495692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e646ea53b14d118f9117713465c499', 'request_id': 'req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.503708 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e646ea53b14d118f9117713465c499', 'request_id': 'req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.521339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] The token cache is being invalidate because project a7e646ea53b14d118f9117713465c499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:03.521730 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.522362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.524106 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 765/1544] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:03 2022] DELETE /identity/v3/projects/a7e646ea53b14d118f9117713465c499 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:03.529476 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd163f9c-c28d-4e8b-ac8f-04bbe5ea2392 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:03.555492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd163f9c-c28d-4e8b-ac8f-04bbe5ea2392 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:03.636866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f83ec2-04cf-495a-9ead-91f917758e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:03.637696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f83ec2-04cf-495a-9ead-91f917758e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:03.638047 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f83ec2-04cf-495a-9ead-91f917758e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:03.638390 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f83ec2-04cf-495a-9ead-91f917758e66 admin admin] PATH_INFO: `/v3/users/93452a0b96c44b80bd631a80c41922e1` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:03.641264 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f83ec2-04cf-495a-9ead-91f917758e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93452a0b96c44b80bd631a80c41922e1)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:03.643440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f83ec2-04cf-495a-9ead-91f917758e66 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:03.933954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f1f83ec2-04cf-495a-9ead-91f917758e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93452a0b96c44b80bd631a80c41922e1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.934841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f1f83ec2-04cf-495a-9ead-91f917758e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93452a0b96c44b80bd631a80c41922e1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.949346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f1f83ec2-04cf-495a-9ead-91f917758e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93452a0b96c44b80bd631a80c41922e1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.950142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f1f83ec2-04cf-495a-9ead-91f917758e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93452a0b96c44b80bd631a80c41922e1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:03.962184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:04.050689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f1f83ec2-04cf-495a-9ead-91f917758e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93452a0b96c44b80bd631a80c41922e1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:04.064246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 780/1545] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:03 2022] DELETE /identity/v3/users/93452a0b96c44b80bd631a80c41922e1 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:04.599968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:04.601749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:04.643100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a3641-6e5c-46de-a4e5-1bdc08152fd5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:04.661134 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:04.705984 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0acf8-b38b-4832-b914-e43ff51a5f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:04.706876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0acf8-b38b-4832-b914-e43ff51a5f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:04.707153 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0acf8-b38b-4832-b914-e43ff51a5f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:04.707536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0acf8-b38b-4832-b914-e43ff51a5f52 admin admin] PATH_INFO: `/v3/projects/3b3df75f826348e6be61e8aef7fffb25` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:04.708582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0acf8-b38b-4832-b914-e43ff51a5f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b3df75f826348e6be61e8aef7fffb25)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:04.710483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0acf8-b38b-4832-b914-e43ff51a5f52 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:04.752425 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:04.845012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-27b0acf8-b38b-4832-b914-e43ff51a5f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b3df75f826348e6be61e8aef7fffb25', 'request_id': 'req-27b0acf8-b38b-4832-b914-e43ff51a5f52'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:04.957981 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-27b0acf8-b38b-4832-b914-e43ff51a5f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b3df75f826348e6be61e8aef7fffb25', 'request_id': 'req-27b0acf8-b38b-4832-b914-e43ff51a5f52'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:04.965373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-27b0acf8-b38b-4832-b914-e43ff51a5f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b3df75f826348e6be61e8aef7fffb25', 'request_id': 'req-27b0acf8-b38b-4832-b914-e43ff51a5f52'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:04.978347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-27b0acf8-b38b-4832-b914-e43ff51a5f52 admin admin] The token cache is being invalidate because project 3b3df75f826348e6be61e8aef7fffb25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:04.978875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-27b0acf8-b38b-4832-b914-e43ff51a5f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:04.982160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-27b0acf8-b38b-4832-b914-e43ff51a5f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:04.983874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 766/1546] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:04 2022] DELETE /identity/v3/projects/3b3df75f826348e6be61e8aef7fffb25 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:04.988956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbca052-0a7c-42ce-8a11-97c0777a42dc None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:04.989242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbca052-0a7c-42ce-8a11-97c0777a42dc None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:04.989547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbca052-0a7c-42ce-8a11-97c0777a42dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.009695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-7cbca052-0a7c-42ce-8a11-97c0777a42dc None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:05.010895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7cbca052-0a7c-42ce-8a11-97c0777a42dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:05.076788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 781/1547] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:05.084814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d4371-153d-4231-b34b-1ded31ee0b70 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.085095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d4371-153d-4231-b34b-1ded31ee0b70 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.085404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d4371-153d-4231-b34b-1ded31ee0b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.106477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-511d4371-153d-4231-b34b-1ded31ee0b70 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:05.107082 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-511d4371-153d-4231-b34b-1ded31ee0b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:05.118117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 767/1548] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:05.122379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbca052-0a7c-42ce-8a11-97c0777a42dc None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:05.132912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbca052-0a7c-42ce-8a11-97c0777a42dc None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:05.137786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e61f22-bbc9-4cba-b2f5-978de40263f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:05.138476 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e61f22-bbc9-4cba-b2f5-978de40263f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.138818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e61f22-bbc9-4cba-b2f5-978de40263f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.139108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e61f22-bbc9-4cba-b2f5-978de40263f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.139944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e61f22-bbc9-4cba-b2f5-978de40263f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:10:05.140316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e61f22-bbc9-4cba-b2f5-978de40263f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:05.141988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e61f22-bbc9-4cba-b2f5-978de40263f2 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:05.153777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 782/1549] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:10:05.158373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d4371-153d-4231-b34b-1ded31ee0b70 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:05.168685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d4371-153d-4231-b34b-1ded31ee0b70 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:05.174947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48d3d-f09e-40ca-9d88-3e77d4057f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:05.175576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48d3d-f09e-40ca-9d88-3e77d4057f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.175864 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48d3d-f09e-40ca-9d88-3e77d4057f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.176387 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48d3d-f09e-40ca-9d88-3e77d4057f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.177030 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba48d3d-f09e-40ca-9d88-3e77d4057f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:05.179055 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba48d3d-f09e-40ca-9d88-3e77d4057f41 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:05.315354 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 768/1550] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:05 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:10:05.319866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e61f22-bbc9-4cba-b2f5-978de40263f2 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:05.363601 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e61f22-bbc9-4cba-b2f5-978de40263f2 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:05.438955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da2e48-a2b7-4168-a7a7-3c6455f595f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:05.439566 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2e48-a2b7-4168-a7a7-3c6455f595f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.439842 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2e48-a2b7-4168-a7a7-3c6455f595f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.440111 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da2e48-a2b7-4168-a7a7-3c6455f595f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.440767 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da2e48-a2b7-4168-a7a7-3c6455f595f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:05.442736 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da2e48-a2b7-4168-a7a7-3c6455f595f4 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:05.573011 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 783/1551] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:05 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:05.574277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48d3d-f09e-40ca-9d88-3e77d4057f41 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:05.585079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48d3d-f09e-40ca-9d88-3e77d4057f41 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:05.589709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ab786-5c84-407a-ad7a-f52c5347847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:05.590317 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ab786-5c84-407a-ad7a-f52c5347847b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.590590 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ab786-5c84-407a-ad7a-f52c5347847b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.591459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ab786-5c84-407a-ad7a-f52c5347847b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.592910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ab786-5c84-407a-ad7a-f52c5347847b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:05.597078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ab786-5c84-407a-ad7a-f52c5347847b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:05.608276 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 769/1552] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:05.612027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da2e48-a2b7-4168-a7a7-3c6455f595f4 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:05.624792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da2e48-a2b7-4168-a7a7-3c6455f595f4 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:05.631517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9f589-9112-4c53-9135-9c622dbe6f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:05.632385 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9f589-9112-4c53-9135-9c622dbe6f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.632726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9f589-9112-4c53-9135-9c622dbe6f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.633059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9f589-9112-4c53-9135-9c622dbe6f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.633848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9f589-9112-4c53-9135-9c622dbe6f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:05.637377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9f589-9112-4c53-9135-9c622dbe6f93 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:05.653071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 784/1553] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:05.655876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ab786-5c84-407a-ad7a-f52c5347847b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:05.673755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ab786-5c84-407a-ad7a-f52c5347847b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:05.680057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90947680-27ad-4475-b62b-b9085d210747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:05.680997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90947680-27ad-4475-b62b-b9085d210747 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.681647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90947680-27ad-4475-b62b-b9085d210747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.681909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90947680-27ad-4475-b62b-b9085d210747 admin admin] PATH_INFO: `/v3/projects/446eaebc9002455ca2083ebfeb7a32c4/users/86c1aa1995e64e098abf97f320184d43/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.707783 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90947680-27ad-4475-b62b-b9085d210747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446eaebc9002455ca2083ebfeb7a32c4, user_id=86c1aa1995e64e098abf97f320184d43, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:05.711224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90947680-27ad-4475-b62b-b9085d210747 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:05.836637 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 770/1554] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:05 2022] PUT /identity/v3/projects/446eaebc9002455ca2083ebfeb7a32c4/users/86c1aa1995e64e098abf97f320184d43/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:05.849322 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291c57b-0724-4f95-9be0-b7753ba1593d None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.849851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291c57b-0724-4f95-9be0-b7753ba1593d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.849851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291c57b-0724-4f95-9be0-b7753ba1593d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.861796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:05.892313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0291c57b-0724-4f95-9be0-b7753ba1593d None None] MFA Rules not processed for user `86c1aa1995e64e098abf97f320184d43`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:05.893783 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0291c57b-0724-4f95-9be0-b7753ba1593d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:05.946514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d779147-77b2-40c3-8b9c-cf00ebaacc40 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.946951 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d779147-77b2-40c3-8b9c-cf00ebaacc40 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.947566 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d779147-77b2-40c3-8b9c-cf00ebaacc40 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.950773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 771/1555] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 31 15:10:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:10:05.989188 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe373b-95c7-4fbd-8175-947d37485b2e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:05.989818 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe373b-95c7-4fbd-8175-947d37485b2e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:05.989818 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe373b-95c7-4fbd-8175-947d37485b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:05.992127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 785/1556] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:05.993036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291c57b-0724-4f95-9be0-b7753ba1593d None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:06.014701 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-efbe373b-95c7-4fbd-8175-947d37485b2e None None] MFA Rules not processed for user `9ec30e419d6f4fddb05c4bb08f2ce3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:06.016123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-efbe373b-95c7-4fbd-8175-947d37485b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:06.088708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291c57b-0724-4f95-9be0-b7753ba1593d None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:06.096405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e015f45-ab4c-404b-ae30-dd9799c2500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:06.097925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015f45-ab4c-404b-ae30-dd9799c2500e admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:06.097925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015f45-ab4c-404b-ae30-dd9799c2500e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:06.097925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015f45-ab4c-404b-ae30-dd9799c2500e admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:06.098636 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e015f45-ab4c-404b-ae30-dd9799c2500e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:06.101389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e015f45-ab4c-404b-ae30-dd9799c2500e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:06.167843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 772/1557] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 31 15:10:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:06.273678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 786/1558] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:05 2022] POST /identity/v3/projects => generated 375 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:06.277854 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe373b-95c7-4fbd-8175-947d37485b2e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:06.278334 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:06.289658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe373b-95c7-4fbd-8175-947d37485b2e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:06.345615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e015f45-ab4c-404b-ae30-dd9799c2500e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:06.347396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3e015f45-ab4c-404b-ae30-dd9799c2500e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:06.378225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b311b-b0ea-48ca-a28d-0c52f6a55f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:06.379297 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b311b-b0ea-48ca-a28d-0c52f6a55f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:06.379623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b311b-b0ea-48ca-a28d-0c52f6a55f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:06.379920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b311b-b0ea-48ca-a28d-0c52f6a55f38 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:06.380540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b311b-b0ea-48ca-a28d-0c52f6a55f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:06.383557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b311b-b0ea-48ca-a28d-0c52f6a55f38 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:06.451908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e015f45-ab4c-404b-ae30-dd9799c2500e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:06.459288 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818bdad-801f-4bd7-ad7f-f2e2dccfda67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:06.459288 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818bdad-801f-4bd7-ad7f-f2e2dccfda67 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:06.459768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818bdad-801f-4bd7-ad7f-f2e2dccfda67 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:06.460138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818bdad-801f-4bd7-ad7f-f2e2dccfda67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:06.470061 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818bdad-801f-4bd7-ad7f-f2e2dccfda67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:06.471962 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818bdad-801f-4bd7-ad7f-f2e2dccfda67 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:06.485913 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 787/1559] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:06.517460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 773/1560] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:06 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:06.521619 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818bdad-801f-4bd7-ad7f-f2e2dccfda67 service nova] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:06.537094 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818bdad-801f-4bd7-ad7f-f2e2dccfda67 service nova] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:06.541917 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9183e-c525-4c43-adf5-68480c312cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:06.542525 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9183e-c525-4c43-adf5-68480c312cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:06.542800 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9183e-c525-4c43-adf5-68480c312cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:06.543069 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9183e-c525-4c43-adf5-68480c312cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:06.543734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9183e-c525-4c43-adf5-68480c312cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:06.545942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9183e-c525-4c43-adf5-68480c312cc0 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:06.556803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 788/1561] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:06.561556 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b311b-b0ea-48ca-a28d-0c52f6a55f38 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:06.571486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b311b-b0ea-48ca-a28d-0c52f6a55f38 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:06.576141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b3f0-1744-4303-84ea-ff2390886755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:06.576797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b3f0-1744-4303-84ea-ff2390886755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:06.577074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b3f0-1744-4303-84ea-ff2390886755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:06.577382 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b3f0-1744-4303-84ea-ff2390886755 admin admin] PATH_INFO: `/v3/projects/f21c108305fe414a8b017aa2065a92e8/users/baa1c43705b447ab9d12f822ffcf36d6/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:06.595610 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217b3f0-1744-4303-84ea-ff2390886755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21c108305fe414a8b017aa2065a92e8, user_id=baa1c43705b447ab9d12f822ffcf36d6, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:06.598442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217b3f0-1744-4303-84ea-ff2390886755 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:06.769917 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 774/1562] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:06 2022] PUT /identity/v3/projects/f21c108305fe414a8b017aa2065a92e8/users/baa1c43705b447ab9d12f822ffcf36d6/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:06.773990 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9183e-c525-4c43-adf5-68480c312cc0 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:06.784361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9183e-c525-4c43-adf5-68480c312cc0 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:06.842450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d28dc-f151-4304-84dd-3127c24c5410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:06.843054 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d28dc-f151-4304-84dd-3127c24c5410 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:06.843330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d28dc-f151-4304-84dd-3127c24c5410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:06.843599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d28dc-f151-4304-84dd-3127c24c5410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:06.844236 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d28dc-f151-4304-84dd-3127c24c5410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:06.846007 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d28dc-f151-4304-84dd-3127c24c5410 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:06.857000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 789/1563] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:06.861734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b3f0-1744-4303-84ea-ff2390886755 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:06.871780 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b3f0-1744-4303-84ea-ff2390886755 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:06.877021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e103d-ad93-450c-a227-85b6453eed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:06.877705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e103d-ad93-450c-a227-85b6453eed6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:06.877983 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e103d-ad93-450c-a227-85b6453eed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:06.878251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e103d-ad93-450c-a227-85b6453eed6c admin admin] PATH_INFO: `/v3/projects/f21c108305fe414a8b017aa2065a92e8/users/baa1c43705b447ab9d12f822ffcf36d6/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:06.880110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e103d-ad93-450c-a227-85b6453eed6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21c108305fe414a8b017aa2065a92e8, user_id=baa1c43705b447ab9d12f822ffcf36d6, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:06.883250 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e103d-ad93-450c-a227-85b6453eed6c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:06.893225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 775/1564] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:06 2022] PUT /identity/v3/projects/f21c108305fe414a8b017aa2065a92e8/users/baa1c43705b447ab9d12f822ffcf36d6/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:06.904005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346156da-8a1e-4e7b-b2cc-faaefb96b5ec None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:06.905010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346156da-8a1e-4e7b-b2cc-faaefb96b5ec None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:06.905307 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346156da-8a1e-4e7b-b2cc-faaefb96b5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:06.938584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-346156da-8a1e-4e7b-b2cc-faaefb96b5ec None None] MFA Rules not processed for user `baa1c43705b447ab9d12f822ffcf36d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:06.939822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-346156da-8a1e-4e7b-b2cc-faaefb96b5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:07.008640 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 790/1565] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:07.019887 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e103d-ad93-450c-a227-85b6453eed6c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:07.021678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ff5e103d-ad93-450c-a227-85b6453eed6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:07.084883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e103d-ad93-450c-a227-85b6453eed6c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:07.088640 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf462971-c644-4bf1-89d0-50d6be8df27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:07.089246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf462971-c644-4bf1-89d0-50d6be8df27c service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:07.089570 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf462971-c644-4bf1-89d0-50d6be8df27c service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:07.089842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf462971-c644-4bf1-89d0-50d6be8df27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:07.157397 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf462971-c644-4bf1-89d0-50d6be8df27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:07.159035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf462971-c644-4bf1-89d0-50d6be8df27c service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:07.169379 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 776/1566] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:07.506164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:07.958652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:08.786833 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:08.844002 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:09.609951 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:10.340783 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:10.397875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:11.020979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346156da-8a1e-4e7b-b2cc-faaefb96b5ec None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:11.032454 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346156da-8a1e-4e7b-b2cc-faaefb96b5ec None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:11.036069 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5b49b-3f6c-47ce-a260-bd98e0605f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:11.036708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5b49b-3f6c-47ce-a260-bd98e0605f09 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:11.036979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5b49b-3f6c-47ce-a260-bd98e0605f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:11.037241 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5b49b-3f6c-47ce-a260-bd98e0605f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:11.046803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5b49b-3f6c-47ce-a260-bd98e0605f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:11.048301 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5b49b-3f6c-47ce-a260-bd98e0605f09 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:11.059045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 791/1567] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:11.735590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:12.427380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:12.631084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:13.358131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:13.706707 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:14.890425 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:15.346377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:16.369943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:16.563796 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:17.187512 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:17.397664 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:17.632731 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:17.912250 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:27.518096 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=30 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:27.964768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=46 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:30.640034 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf462971-c644-4bf1-89d0-50d6be8df27c service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:30.642964 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bf462971-c644-4bf1-89d0-50d6be8df27c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:30.741095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf462971-c644-4bf1-89d0-50d6be8df27c service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:30.748274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:30.749058 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:30.749365 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:30.749638 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] PATH_INFO: `/v3/users/0b23194584cc4908b044da3e1e499c75` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:30.750862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b23194584cc4908b044da3e1e499c75)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:30.752838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:31.001625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b23194584cc4908b044da3e1e499c75'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:31.002404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b23194584cc4908b044da3e1e499c75'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:31.010852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b23194584cc4908b044da3e1e499c75'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:31.096569 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b23194584cc4908b044da3e1e499c75'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:31.110532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b23194584cc4908b044da3e1e499c75'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:31.117034 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 777/1568] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:30 2022] DELETE /identity/v3/users/0b23194584cc4908b044da3e1e499c75 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:31.121458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013d417-e59b-4ca1-9c6f-ce67bb285c86 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:31.121964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013d417-e59b-4ca1-9c6f-ce67bb285c86 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:31.122067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013d417-e59b-4ca1-9c6f-ce67bb285c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:31.146718 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0013d417-e59b-4ca1-9c6f-ce67bb285c86 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:31.147923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0013d417-e59b-4ca1-9c6f-ce67bb285c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:31.213428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 792/1569] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:31.224247 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:31.225991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:31.306922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779a5e7-59cb-493c-8f4e-64b86a9bad5a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:31.310985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5ccfd-94b9-48d8-9757-bf514b2d93a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:31.315373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5ccfd-94b9-48d8-9757-bf514b2d93a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:31.315373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5ccfd-94b9-48d8-9757-bf514b2d93a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:31.315373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5ccfd-94b9-48d8-9757-bf514b2d93a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:31.321089 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5ccfd-94b9-48d8-9757-bf514b2d93a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:31.322550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5ccfd-94b9-48d8-9757-bf514b2d93a7 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:31.332568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 778/1570] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:31.840460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013d417-e59b-4ca1-9c6f-ce67bb285c86 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:31.842110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0013d417-e59b-4ca1-9c6f-ce67bb285c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:31.854957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013d417-e59b-4ca1-9c6f-ce67bb285c86 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:31.859811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fa8cf-7187-4777-888b-db7df3b26066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:31.860438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fa8cf-7187-4777-888b-db7df3b26066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:31.860717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fa8cf-7187-4777-888b-db7df3b26066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:31.860983 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fa8cf-7187-4777-888b-db7df3b26066 admin admin] PATH_INFO: `/v3/projects/6987d433c13744f186c4109233f19e18` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:31.862137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fa8cf-7187-4777-888b-db7df3b26066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6987d433c13744f186c4109233f19e18)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:31.864022 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fa8cf-7187-4777-888b-db7df3b26066 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:31.983120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bb4fa8cf-7187-4777-888b-db7df3b26066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6987d433c13744f186c4109233f19e18', 'request_id': 'req-bb4fa8cf-7187-4777-888b-db7df3b26066'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:32.145870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bb4fa8cf-7187-4777-888b-db7df3b26066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6987d433c13744f186c4109233f19e18', 'request_id': 'req-bb4fa8cf-7187-4777-888b-db7df3b26066'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:32.153065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bb4fa8cf-7187-4777-888b-db7df3b26066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6987d433c13744f186c4109233f19e18', 'request_id': 'req-bb4fa8cf-7187-4777-888b-db7df3b26066'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:32.163965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bb4fa8cf-7187-4777-888b-db7df3b26066 admin admin] The token cache is being invalidate because project 6987d433c13744f186c4109233f19e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:32.164251 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bb4fa8cf-7187-4777-888b-db7df3b26066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:32.164916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bb4fa8cf-7187-4777-888b-db7df3b26066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:32.166472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 793/1571] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:31 2022] DELETE /identity/v3/projects/6987d433c13744f186c4109233f19e18 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:32.172024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f848a-b92f-43b9-a21b-e47e61305d8c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:32.174629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f848a-b92f-43b9-a21b-e47e61305d8c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:32.174629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f848a-b92f-43b9-a21b-e47e61305d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:32.198093 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b18f848a-b92f-43b9-a21b-e47e61305d8c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:32.199639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b18f848a-b92f-43b9-a21b-e47e61305d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:32.219339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:32.263338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 779/1572] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:32.271035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9a079-cf6a-4da8-a950-ab9a2ffde895 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:32.273133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9a079-cf6a-4da8-a950-ab9a2ffde895 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:32.273133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9a079-cf6a-4da8-a950-ab9a2ffde895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:32.291636 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-b8e9a079-cf6a-4da8-a950-ab9a2ffde895 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:32.292892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b8e9a079-cf6a-4da8-a950-ab9a2ffde895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:32.301795 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 794/1573] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:32.306102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f848a-b92f-43b9-a21b-e47e61305d8c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:32.319075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f848a-b92f-43b9-a21b-e47e61305d8c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:32.322387 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63624672-1bef-4a42-aa85-842a7454acfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:32.323001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63624672-1bef-4a42-aa85-842a7454acfd admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:32.323278 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63624672-1bef-4a42-aa85-842a7454acfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:32.323549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63624672-1bef-4a42-aa85-842a7454acfd admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:32.324513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63624672-1bef-4a42-aa85-842a7454acfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:10:32.324869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63624672-1bef-4a42-aa85-842a7454acfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:32.337462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63624672-1bef-4a42-aa85-842a7454acfd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:32.339311 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 780/1574] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:10:32.345559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9a079-cf6a-4da8-a950-ab9a2ffde895 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:32.355374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9a079-cf6a-4da8-a950-ab9a2ffde895 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:32.361699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805f133-1851-487a-9572-ddb8945c8797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:32.362337 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805f133-1851-487a-9572-ddb8945c8797 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:32.362676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805f133-1851-487a-9572-ddb8945c8797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:32.362947 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805f133-1851-487a-9572-ddb8945c8797 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:32.363578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805f133-1851-487a-9572-ddb8945c8797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:32.365632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805f133-1851-487a-9572-ddb8945c8797 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:32.474216 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 795/1575] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:32 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:32.478408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63624672-1bef-4a42-aa85-842a7454acfd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:32.489071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63624672-1bef-4a42-aa85-842a7454acfd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:32.547202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a6749-5c01-42fd-86bd-ca44882ec188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:32.547726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a6749-5c01-42fd-86bd-ca44882ec188 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:32.548002 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a6749-5c01-42fd-86bd-ca44882ec188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:32.548274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a6749-5c01-42fd-86bd-ca44882ec188 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:32.548908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a6749-5c01-42fd-86bd-ca44882ec188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:32.551233 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a6749-5c01-42fd-86bd-ca44882ec188 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:32.655309 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 781/1576] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:32 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:32.659542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805f133-1851-487a-9572-ddb8945c8797 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:32.670654 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805f133-1851-487a-9572-ddb8945c8797 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:32.675258 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f2d4b-1b83-47b5-bdcd-a84010823411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:32.675840 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f2d4b-1b83-47b5-bdcd-a84010823411 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:32.676371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f2d4b-1b83-47b5-bdcd-a84010823411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:32.676636 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f2d4b-1b83-47b5-bdcd-a84010823411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:32.677268 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f2d4b-1b83-47b5-bdcd-a84010823411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:32.678874 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f2d4b-1b83-47b5-bdcd-a84010823411 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:32.688683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 796/1577] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:32.692617 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a6749-5c01-42fd-86bd-ca44882ec188 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:32.703363 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a6749-5c01-42fd-86bd-ca44882ec188 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:32.709213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ff1f4-8591-4ef4-a69c-a131da905f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:32.709853 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ff1f4-8591-4ef4-a69c-a131da905f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:32.710130 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ff1f4-8591-4ef4-a69c-a131da905f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:32.714115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ff1f4-8591-4ef4-a69c-a131da905f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:32.714115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ff1f4-8591-4ef4-a69c-a131da905f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:32.714115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ff1f4-8591-4ef4-a69c-a131da905f00 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:32.725082 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 782/1578] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:10:32.729370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f2d4b-1b83-47b5-bdcd-a84010823411 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:32.740677 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f2d4b-1b83-47b5-bdcd-a84010823411 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:32.747456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316ede5-8c3a-40b2-8196-b28d4d0fa1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:32.748193 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ede5-8c3a-40b2-8196-b28d4d0fa1d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:32.748537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ede5-8c3a-40b2-8196-b28d4d0fa1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:32.749257 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316ede5-8c3a-40b2-8196-b28d4d0fa1d9 admin admin] PATH_INFO: `/v3/projects/5ba902056e1945e2816280500cf994b1/users/e0128f0abf3f46daa1df55e971d9c848/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:32.765779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316ede5-8c3a-40b2-8196-b28d4d0fa1d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba902056e1945e2816280500cf994b1, user_id=e0128f0abf3f46daa1df55e971d9c848, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:32.768474 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316ede5-8c3a-40b2-8196-b28d4d0fa1d9 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:32.873541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 797/1579] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:32 2022] PUT /identity/v3/projects/5ba902056e1945e2816280500cf994b1/users/e0128f0abf3f46daa1df55e971d9c848/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:32.879284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fad52-558e-4c2f-880c-2797b3c4a609 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:32.879568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fad52-558e-4c2f-880c-2797b3c4a609 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:32.879847 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fad52-558e-4c2f-880c-2797b3c4a609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:32.910190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ae0fad52-558e-4c2f-880c-2797b3c4a609 None None] MFA Rules not processed for user `e0128f0abf3f46daa1df55e971d9c848`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:32.911426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ae0fad52-558e-4c2f-880c-2797b3c4a609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:32.984336 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 783/1580] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:32.985553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316ede5-8c3a-40b2-8196-b28d4d0fa1d9 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:33.007266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:33.068934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316ede5-8c3a-40b2-8196-b28d4d0fa1d9 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:33.068934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40660c85-3c0c-4c16-8625-6f06d8d5a0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:33.068934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40660c85-3c0c-4c16-8625-6f06d8d5a0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:33.068934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40660c85-3c0c-4c16-8625-6f06d8d5a0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:33.070052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40660c85-3c0c-4c16-8625-6f06d8d5a0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:33.070052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40660c85-3c0c-4c16-8625-6f06d8d5a0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:33.070052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40660c85-3c0c-4c16-8625-6f06d8d5a0c0 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:33.188476 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 798/1581] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:32 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:10:33.192482 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fad52-558e-4c2f-880c-2797b3c4a609 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:33.205792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fad52-558e-4c2f-880c-2797b3c4a609 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:33.221323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:33.258764 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40660c85-3c0c-4c16-8625-6f06d8d5a0c0 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:33.264230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-40660c85-3c0c-4c16-8625-6f06d8d5a0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:33.273623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186ab17-8913-4808-a4d7-5efa47f8bcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:33.274529 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186ab17-8913-4808-a4d7-5efa47f8bcd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:33.274808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186ab17-8913-4808-a4d7-5efa47f8bcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:33.275201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186ab17-8913-4808-a4d7-5efa47f8bcd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:33.276087 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186ab17-8913-4808-a4d7-5efa47f8bcd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:33.278876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186ab17-8913-4808-a4d7-5efa47f8bcd7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:33.333093 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40660c85-3c0c-4c16-8625-6f06d8d5a0c0 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:33.338697 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f2e8d-bebf-4a81-8e28-1483e277a41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:33.339349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f2e8d-bebf-4a81-8e28-1483e277a41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:33.339637 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f2e8d-bebf-4a81-8e28-1483e277a41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:33.339912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f2e8d-bebf-4a81-8e28-1483e277a41b admin admin] PATH_INFO: `/v3/users/86c1aa1995e64e098abf97f320184d43` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:33.341375 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f2e8d-bebf-4a81-8e28-1483e277a41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c1aa1995e64e098abf97f320184d43)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:33.343098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f2e8d-bebf-4a81-8e28-1483e277a41b admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:33.397455 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 784/1582] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:33 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:33.401686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186ab17-8913-4808-a4d7-5efa47f8bcd7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:33.412028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186ab17-8913-4808-a4d7-5efa47f8bcd7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:33.416761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec42f44-5e77-4874-b2fe-bb5b18fb25af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:33.417402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec42f44-5e77-4874-b2fe-bb5b18fb25af admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:33.417682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec42f44-5e77-4874-b2fe-bb5b18fb25af admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:33.417955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec42f44-5e77-4874-b2fe-bb5b18fb25af admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:33.418648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec42f44-5e77-4874-b2fe-bb5b18fb25af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:33.420295 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec42f44-5e77-4874-b2fe-bb5b18fb25af admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:33.431362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 785/1583] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:10:33.435953 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec42f44-5e77-4874-b2fe-bb5b18fb25af admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:33.446126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec42f44-5e77-4874-b2fe-bb5b18fb25af admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:33.453172 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ea4fe-712f-4210-8833-8d3b7e1c92d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:33.453848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ea4fe-712f-4210-8833-8d3b7e1c92d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:33.454136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ea4fe-712f-4210-8833-8d3b7e1c92d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:33.454404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ea4fe-712f-4210-8833-8d3b7e1c92d0 admin admin] PATH_INFO: `/v3/projects/a7bb7a92a66243a1860853d135039765/users/3e5ae52a82454d76bdf833f9e9ec664a/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:33.471000 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ea4fe-712f-4210-8833-8d3b7e1c92d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7bb7a92a66243a1860853d135039765, user_id=3e5ae52a82454d76bdf833f9e9ec664a, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:33.473891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ea4fe-712f-4210-8833-8d3b7e1c92d0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:33.551392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 786/1584] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:33 2022] PUT /identity/v3/projects/a7bb7a92a66243a1860853d135039765/users/3e5ae52a82454d76bdf833f9e9ec664a/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:33.555117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ea4fe-712f-4210-8833-8d3b7e1c92d0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:33.584240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-245f2e8d-bebf-4a81-8e28-1483e277a41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c1aa1995e64e098abf97f320184d43'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:33.584827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-245f2e8d-bebf-4a81-8e28-1483e277a41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c1aa1995e64e098abf97f320184d43'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:33.598934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-245f2e8d-bebf-4a81-8e28-1483e277a41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c1aa1995e64e098abf97f320184d43'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:33.602176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-245f2e8d-bebf-4a81-8e28-1483e277a41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c1aa1995e64e098abf97f320184d43'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:33.632021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ea4fe-712f-4210-8833-8d3b7e1c92d0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:33.636683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162856b2-e3c1-4864-9d8c-e62f8b7db68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:33.637417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162856b2-e3c1-4864-9d8c-e62f8b7db68b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:33.637783 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162856b2-e3c1-4864-9d8c-e62f8b7db68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:33.638060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162856b2-e3c1-4864-9d8c-e62f8b7db68b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:33.638713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162856b2-e3c1-4864-9d8c-e62f8b7db68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:33.640340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162856b2-e3c1-4864-9d8c-e62f8b7db68b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:33.650654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 787/1585] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:10:33.654852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162856b2-e3c1-4864-9d8c-e62f8b7db68b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:33.656657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-162856b2-e3c1-4864-9d8c-e62f8b7db68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:33.670212 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162856b2-e3c1-4864-9d8c-e62f8b7db68b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:33.671702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-245f2e8d-bebf-4a81-8e28-1483e277a41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c1aa1995e64e098abf97f320184d43'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:33.676846 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9901f-5219-4c78-ae78-0700d8edd7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:33.677639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9901f-5219-4c78-ae78-0700d8edd7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:33.677979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9901f-5219-4c78-ae78-0700d8edd7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:33.678322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9901f-5219-4c78-ae78-0700d8edd7ea admin admin] PATH_INFO: `/v3/projects/a7bb7a92a66243a1860853d135039765/users/3e5ae52a82454d76bdf833f9e9ec664a/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:33.680329 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9901f-5219-4c78-ae78-0700d8edd7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7bb7a92a66243a1860853d135039765, user_id=3e5ae52a82454d76bdf833f9e9ec664a, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:33.683219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9901f-5219-4c78-ae78-0700d8edd7ea admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:33.686927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 799/1586] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:33 2022] DELETE /identity/v3/users/86c1aa1995e64e098abf97f320184d43 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:33.690990 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81977c7d-6ad3-466f-9671-80066df5670b None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:33.691554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81977c7d-6ad3-466f-9671-80066df5670b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:33.691554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81977c7d-6ad3-466f-9671-80066df5670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:33.698834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 788/1587] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:33 2022] PUT /identity/v3/projects/a7bb7a92a66243a1860853d135039765/users/3e5ae52a82454d76bdf833f9e9ec664a/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:33.711232 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-81977c7d-6ad3-466f-9671-80066df5670b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:33.711408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e9963-1018-4e7c-8a33-8a791054f912 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:33.711598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e9963-1018-4e7c-8a33-8a791054f912 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:33.711922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e9963-1018-4e7c-8a33-8a791054f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:33.712484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-81977c7d-6ad3-466f-9671-80066df5670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:33.734416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:33.743020 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2f6e9963-1018-4e7c-8a33-8a791054f912 None None] MFA Rules not processed for user `3e5ae52a82454d76bdf833f9e9ec664a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:33.744267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2f6e9963-1018-4e7c-8a33-8a791054f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:33.781129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 800/1588] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:10:33.790684 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81977c7d-6ad3-466f-9671-80066df5670b None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:33.792043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-81977c7d-6ad3-466f-9671-80066df5670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:33.792626 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:33.818489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 789/1589] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:10:33.829491 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e9963-1018-4e7c-8a33-8a791054f912 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:33.830876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2f6e9963-1018-4e7c-8a33-8a791054f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:33.858478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81977c7d-6ad3-466f-9671-80066df5670b None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:33.862693 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e6075-0633-459a-b270-6c9ae0a9000c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:33.863537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e6075-0633-459a-b270-6c9ae0a9000c service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:33.863936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e6075-0633-459a-b270-6c9ae0a9000c service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:33.864323 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e6075-0633-459a-b270-6c9ae0a9000c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:33.898692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e6075-0633-459a-b270-6c9ae0a9000c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:33.900417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e6075-0633-459a-b270-6c9ae0a9000c service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:33.915126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 801/1590] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:10:33.923312 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e9963-1018-4e7c-8a33-8a791054f912 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:33.928610 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719462f-c764-404d-8dec-8d0b28eb876e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:33.928610 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719462f-c764-404d-8dec-8d0b28eb876e service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:33.928951 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719462f-c764-404d-8dec-8d0b28eb876e service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:33.929368 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719462f-c764-404d-8dec-8d0b28eb876e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:33.931200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5719462f-c764-404d-8dec-8d0b28eb876e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:34.038693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719462f-c764-404d-8dec-8d0b28eb876e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:34.040441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719462f-c764-404d-8dec-8d0b28eb876e service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:34.052158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 790/1591] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:10:34.628374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e6075-0633-459a-b270-6c9ae0a9000c service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:34.636740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-be1e6075-0633-459a-b270-6c9ae0a9000c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:34.644092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e6075-0633-459a-b270-6c9ae0a9000c service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:34.648782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:34.649439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:34.649713 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:34.649982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] PATH_INFO: `/v3/projects/446eaebc9002455ca2083ebfeb7a32c4` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:34.651078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=446eaebc9002455ca2083ebfeb7a32c4)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:34.653054 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:34.821734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446eaebc9002455ca2083ebfeb7a32c4', 'request_id': 'req-c1ebdd74-0988-4df2-a376-c148c10cb788'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:34.928779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446eaebc9002455ca2083ebfeb7a32c4', 'request_id': 'req-c1ebdd74-0988-4df2-a376-c148c10cb788'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:34.937019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446eaebc9002455ca2083ebfeb7a32c4', 'request_id': 'req-c1ebdd74-0988-4df2-a376-c148c10cb788'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:34.954985 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] The token cache is being invalidate because project 446eaebc9002455ca2083ebfeb7a32c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:34.955270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:34.956138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:34.957961 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 802/1592] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:34 2022] DELETE /identity/v3/projects/446eaebc9002455ca2083ebfeb7a32c4 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:34.962789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719462f-c764-404d-8dec-8d0b28eb876e service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:34.979730 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719462f-c764-404d-8dec-8d0b28eb876e service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:35.049147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2650300-f0b8-4cf5-9637-e719b7879a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:35.049908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2650300-f0b8-4cf5-9637-e719b7879a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:35.050192 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2650300-f0b8-4cf5-9637-e719b7879a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:35.050468 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2650300-f0b8-4cf5-9637-e719b7879a11 admin admin] PATH_INFO: `/v3/users/baa1c43705b447ab9d12f822ffcf36d6` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:35.051966 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2650300-f0b8-4cf5-9637-e719b7879a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa1c43705b447ab9d12f822ffcf36d6)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:35.054104 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2650300-f0b8-4cf5-9637-e719b7879a11 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:35.289112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:35.298776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b2650300-f0b8-4cf5-9637-e719b7879a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa1c43705b447ab9d12f822ffcf36d6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:35.299534 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b2650300-f0b8-4cf5-9637-e719b7879a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa1c43705b447ab9d12f822ffcf36d6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:35.307507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b2650300-f0b8-4cf5-9637-e719b7879a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa1c43705b447ab9d12f822ffcf36d6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:35.358666 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b2650300-f0b8-4cf5-9637-e719b7879a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa1c43705b447ab9d12f822ffcf36d6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:35.375227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b2650300-f0b8-4cf5-9637-e719b7879a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa1c43705b447ab9d12f822ffcf36d6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:35.382773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 791/1593] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:34 2022] DELETE /identity/v3/users/baa1c43705b447ab9d12f822ffcf36d6 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:35.833640 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:35.836810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:35.851831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebdd74-0988-4df2-a376-c148c10cb788 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:35.901117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:35.911958 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e1a31-bab8-4848-9b1e-32c6658aeb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:35.912588 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e1a31-bab8-4848-9b1e-32c6658aeb6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:35.912896 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e1a31-bab8-4848-9b1e-32c6658aeb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:35.913165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e1a31-bab8-4848-9b1e-32c6658aeb6c admin admin] PATH_INFO: `/v3/projects/f21c108305fe414a8b017aa2065a92e8` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:35.914307 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e1a31-bab8-4848-9b1e-32c6658aeb6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f21c108305fe414a8b017aa2065a92e8)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:35.916269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e1a31-bab8-4848-9b1e-32c6658aeb6c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:36.017030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-047e1a31-bab8-4848-9b1e-32c6658aeb6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f21c108305fe414a8b017aa2065a92e8', 'request_id': 'req-047e1a31-bab8-4848-9b1e-32c6658aeb6c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:36.117421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-047e1a31-bab8-4848-9b1e-32c6658aeb6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f21c108305fe414a8b017aa2065a92e8', 'request_id': 'req-047e1a31-bab8-4848-9b1e-32c6658aeb6c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:36.124891 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-047e1a31-bab8-4848-9b1e-32c6658aeb6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f21c108305fe414a8b017aa2065a92e8', 'request_id': 'req-047e1a31-bab8-4848-9b1e-32c6658aeb6c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:36.138139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-047e1a31-bab8-4848-9b1e-32c6658aeb6c admin admin] The token cache is being invalidate because project f21c108305fe414a8b017aa2065a92e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:36.139521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-047e1a31-bab8-4848-9b1e-32c6658aeb6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:36.139521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-047e1a31-bab8-4848-9b1e-32c6658aeb6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:36.140858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 803/1594] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:35 2022] DELETE /identity/v3/projects/f21c108305fe414a8b017aa2065a92e8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:36.145756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a7c7a-c41f-4f9f-ab6a-75fc3985618b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:36.146321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a7c7a-c41f-4f9f-ab6a-75fc3985618b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:36.146486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a7c7a-c41f-4f9f-ab6a-75fc3985618b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:36.166828 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e89a7c7a-c41f-4f9f-ab6a-75fc3985618b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:36.168172 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e89a7c7a-c41f-4f9f-ab6a-75fc3985618b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:36.237795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 792/1595] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:36.244363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8fa5f-4ded-435d-98a3-aff5a99bb6e9 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:36.244645 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8fa5f-4ded-435d-98a3-aff5a99bb6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:36.244914 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8fa5f-4ded-435d-98a3-aff5a99bb6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:36.267023 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-31c8fa5f-4ded-435d-98a3-aff5a99bb6e9 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:36.268250 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-31c8fa5f-4ded-435d-98a3-aff5a99bb6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:36.276267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 804/1596] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:10:36.281364 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a7c7a-c41f-4f9f-ab6a-75fc3985618b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:36.292162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a7c7a-c41f-4f9f-ab6a-75fc3985618b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:36.297694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4caef-75fe-4bde-bb1d-57514aa56247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:36.298344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4caef-75fe-4bde-bb1d-57514aa56247 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:36.298668 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4caef-75fe-4bde-bb1d-57514aa56247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:36.298941 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4caef-75fe-4bde-bb1d-57514aa56247 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:36.299635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4caef-75fe-4bde-bb1d-57514aa56247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:10:36.299944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4caef-75fe-4bde-bb1d-57514aa56247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:36.301861 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4caef-75fe-4bde-bb1d-57514aa56247 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:36.314509 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 793/1597] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:10:36.319083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8fa5f-4ded-435d-98a3-aff5a99bb6e9 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:36.329850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8fa5f-4ded-435d-98a3-aff5a99bb6e9 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:36.334445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692f090-4472-49b5-936b-adf94b02d14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:36.335035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692f090-4472-49b5-936b-adf94b02d14c admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:36.335307 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692f090-4472-49b5-936b-adf94b02d14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:36.335571 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692f090-4472-49b5-936b-adf94b02d14c admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:36.336251 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692f090-4472-49b5-936b-adf94b02d14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:36.338468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692f090-4472-49b5-936b-adf94b02d14c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:36.487993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 805/1598] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:36 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:36.489448 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4caef-75fe-4bde-bb1d-57514aa56247 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:36.500955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4caef-75fe-4bde-bb1d-57514aa56247 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:36.558333 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ee721-9c61-4414-9e5d-7fca8e75591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:36.558937 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ee721-9c61-4414-9e5d-7fca8e75591e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:36.559766 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ee721-9c61-4414-9e5d-7fca8e75591e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:36.560036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ee721-9c61-4414-9e5d-7fca8e75591e admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:36.560673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ee721-9c61-4414-9e5d-7fca8e75591e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:36.562638 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ee721-9c61-4414-9e5d-7fca8e75591e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:36.632386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 794/1599] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:36 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:36.635888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692f090-4472-49b5-936b-adf94b02d14c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:36.647937 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692f090-4472-49b5-936b-adf94b02d14c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:36.656719 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e202690-afae-4b1d-b4aa-c42bf2ea7b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:36.657433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202690-afae-4b1d-b4aa-c42bf2ea7b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:36.657779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202690-afae-4b1d-b4aa-c42bf2ea7b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:36.658314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202690-afae-4b1d-b4aa-c42bf2ea7b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:36.659057 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e202690-afae-4b1d-b4aa-c42bf2ea7b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:36.660834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e202690-afae-4b1d-b4aa-c42bf2ea7b64 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:36.680687 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 806/1600] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:36.685310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ee721-9c61-4414-9e5d-7fca8e75591e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:36.697843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ee721-9c61-4414-9e5d-7fca8e75591e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:36.705342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378a883-9816-4167-860e-97360a86629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:36.706091 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378a883-9816-4167-860e-97360a86629d admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:36.706594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378a883-9816-4167-860e-97360a86629d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:36.707074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378a883-9816-4167-860e-97360a86629d admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:36.707825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378a883-9816-4167-860e-97360a86629d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:36.709724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378a883-9816-4167-860e-97360a86629d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:36.725087 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 795/1601] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:36.729044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e202690-afae-4b1d-b4aa-c42bf2ea7b64 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:36.747881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e202690-afae-4b1d-b4aa-c42bf2ea7b64 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:36.753437 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46506ad9-550e-4570-bce7-239fb2b0b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:36.754097 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46506ad9-550e-4570-bce7-239fb2b0b9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:36.754400 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46506ad9-550e-4570-bce7-239fb2b0b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:36.754668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46506ad9-550e-4570-bce7-239fb2b0b9bf admin admin] PATH_INFO: `/v3/projects/55b34ab067894776a9a408e0a325b36a/users/14a61a00fd124d42aba9c7c0131b44f5/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:36.775176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46506ad9-550e-4570-bce7-239fb2b0b9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b34ab067894776a9a408e0a325b36a, user_id=14a61a00fd124d42aba9c7c0131b44f5, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:36.775176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46506ad9-550e-4570-bce7-239fb2b0b9bf admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:36.858162 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 807/1602] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:36 2022] PUT /identity/v3/projects/55b34ab067894776a9a408e0a325b36a/users/14a61a00fd124d42aba9c7c0131b44f5/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:36.869555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275291b-9093-4efe-a590-0897a767cea1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:36.869929 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275291b-9093-4efe-a590-0897a767cea1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:36.870156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275291b-9093-4efe-a590-0897a767cea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:36.898886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7275291b-9093-4efe-a590-0897a767cea1 None None] MFA Rules not processed for user `14a61a00fd124d42aba9c7c0131b44f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:36.900092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7275291b-9093-4efe-a590-0897a767cea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:36.909618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:36.970244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 796/1603] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:36.974874 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46506ad9-550e-4570-bce7-239fb2b0b9bf admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:37.041485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46506ad9-550e-4570-bce7-239fb2b0b9bf admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:37.047325 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5288d2e-7783-492a-ab37-2baa7b1916c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:37.047941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5288d2e-7783-492a-ab37-2baa7b1916c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:37.048222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5288d2e-7783-492a-ab37-2baa7b1916c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:37.048494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5288d2e-7783-492a-ab37-2baa7b1916c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:37.049212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5288d2e-7783-492a-ab37-2baa7b1916c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:37.051811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5288d2e-7783-492a-ab37-2baa7b1916c9 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:37.198643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 808/1604] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:36 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:37.202919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275291b-9093-4efe-a590-0897a767cea1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:37.213476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275291b-9093-4efe-a590-0897a767cea1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:37.272120 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fa36d-4e35-468a-a3c5-a2fec77906c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:37.272647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fa36d-4e35-468a-a3c5-a2fec77906c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:37.272926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fa36d-4e35-468a-a3c5-a2fec77906c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:37.273193 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fa36d-4e35-468a-a3c5-a2fec77906c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:37.273895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fa36d-4e35-468a-a3c5-a2fec77906c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:37.275918 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fa36d-4e35-468a-a3c5-a2fec77906c1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:37.339676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5288d2e-7783-492a-ab37-2baa7b1916c9 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:37.339676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a5288d2e-7783-492a-ab37-2baa7b1916c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:37.339676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:37.339676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5288d2e-7783-492a-ab37-2baa7b1916c9 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:37.339993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e9a37-6c2b-4bb5-91c8-dfa80d2f39be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:37.339993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e9a37-6c2b-4bb5-91c8-dfa80d2f39be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:37.339993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e9a37-6c2b-4bb5-91c8-dfa80d2f39be admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:37.339993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e9a37-6c2b-4bb5-91c8-dfa80d2f39be admin admin] PATH_INFO: `/v3/users/e0128f0abf3f46daa1df55e971d9c848` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:37.340346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e9a37-6c2b-4bb5-91c8-dfa80d2f39be admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0128f0abf3f46daa1df55e971d9c848)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:37.340346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e9a37-6c2b-4bb5-91c8-dfa80d2f39be admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:37.488756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 797/1605] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:37 2022] POST /identity/v3/users => generated 299 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:37.492419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fa36d-4e35-468a-a3c5-a2fec77906c1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:37.502133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fa36d-4e35-468a-a3c5-a2fec77906c1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:37.506982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d3ab-e3c5-4378-aa2f-a8bff2505cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:37.507643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d3ab-e3c5-4378-aa2f-a8bff2505cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:37.508239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d3ab-e3c5-4378-aa2f-a8bff2505cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:37.508239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d3ab-e3c5-4378-aa2f-a8bff2505cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:37.508860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033d3ab-e3c5-4378-aa2f-a8bff2505cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:37.510603 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033d3ab-e3c5-4378-aa2f-a8bff2505cdc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:37.521398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 798/1606] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:10:37.525519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d3ab-e3c5-4378-aa2f-a8bff2505cdc admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:37.535410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d3ab-e3c5-4378-aa2f-a8bff2505cdc admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:37.540035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5078bfd-3544-4db2-abba-6a372b42c313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:37.540644 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5078bfd-3544-4db2-abba-6a372b42c313 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:37.540918 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5078bfd-3544-4db2-abba-6a372b42c313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:37.541185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5078bfd-3544-4db2-abba-6a372b42c313 admin admin] PATH_INFO: `/v3/projects/987c370341b645b296c01992b899ece1/users/6e735744ecdf461a8cc417dd2197b071/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:37.555592 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5078bfd-3544-4db2-abba-6a372b42c313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987c370341b645b296c01992b899ece1, user_id=6e735744ecdf461a8cc417dd2197b071, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:37.558328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5078bfd-3544-4db2-abba-6a372b42c313 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:37.624550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c04e9a37-6c2b-4bb5-91c8-dfa80d2f39be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0128f0abf3f46daa1df55e971d9c848'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:37.625573 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c04e9a37-6c2b-4bb5-91c8-dfa80d2f39be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0128f0abf3f46daa1df55e971d9c848'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:37.636702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 799/1607] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:37 2022] PUT /identity/v3/projects/987c370341b645b296c01992b899ece1/users/6e735744ecdf461a8cc417dd2197b071/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:37.638667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5078bfd-3544-4db2-abba-6a372b42c313 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:37.640459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c5078bfd-3544-4db2-abba-6a372b42c313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:37.641462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c04e9a37-6c2b-4bb5-91c8-dfa80d2f39be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0128f0abf3f46daa1df55e971d9c848'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:37.642145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c04e9a37-6c2b-4bb5-91c8-dfa80d2f39be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0128f0abf3f46daa1df55e971d9c848'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:37.705494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5078bfd-3544-4db2-abba-6a372b42c313 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:37.710136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a32c9-fe27-4c08-b308-e4157f0e15b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:37.710756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a32c9-fe27-4c08-b308-e4157f0e15b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:37.711039 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a32c9-fe27-4c08-b308-e4157f0e15b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:37.711330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a32c9-fe27-4c08-b308-e4157f0e15b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:37.711965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a32c9-fe27-4c08-b308-e4157f0e15b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:37.713586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a32c9-fe27-4c08-b308-e4157f0e15b0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:37.718919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:37.723844 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 800/1608] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:37.727921 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a32c9-fe27-4c08-b308-e4157f0e15b0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:37.734264 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c04e9a37-6c2b-4bb5-91c8-dfa80d2f39be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0128f0abf3f46daa1df55e971d9c848'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:37.737349 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a32c9-fe27-4c08-b308-e4157f0e15b0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:37.741992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9d8df-cf2e-493a-861d-db221475ac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:37.742639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d8df-cf2e-493a-861d-db221475ac92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:37.742915 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d8df-cf2e-493a-861d-db221475ac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:37.743188 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9d8df-cf2e-493a-861d-db221475ac92 admin admin] PATH_INFO: `/v3/projects/987c370341b645b296c01992b899ece1/users/6e735744ecdf461a8cc417dd2197b071/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:37.745314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9d8df-cf2e-493a-861d-db221475ac92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987c370341b645b296c01992b899ece1, user_id=6e735744ecdf461a8cc417dd2197b071, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:37.748591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9d8df-cf2e-493a-861d-db221475ac92 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:37.748725 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 809/1609] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:37 2022] DELETE /identity/v3/users/e0128f0abf3f46daa1df55e971d9c848 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:37.754266 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3581f9-92c4-40a8-8471-c7f56a2fe35f None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:37.754461 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3581f9-92c4-40a8-8471-c7f56a2fe35f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:37.754799 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3581f9-92c4-40a8-8471-c7f56a2fe35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:37.761713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 801/1610] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:37 2022] PUT /identity/v3/projects/987c370341b645b296c01992b899ece1/users/6e735744ecdf461a8cc417dd2197b071/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:37.778104 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-2b3581f9-92c4-40a8-8471-c7f56a2fe35f None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:37.779840 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2b3581f9-92c4-40a8-8471-c7f56a2fe35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:37.783010 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937b7d5-bd5d-4b16-93c2-bb6762cfc115 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:37.783299 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937b7d5-bd5d-4b16-93c2-bb6762cfc115 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:37.783573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937b7d5-bd5d-4b16-93c2-bb6762cfc115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:37.819322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4937b7d5-bd5d-4b16-93c2-bb6762cfc115 None None] MFA Rules not processed for user `6e735744ecdf461a8cc417dd2197b071`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:37.820549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4937b7d5-bd5d-4b16-93c2-bb6762cfc115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:37.851402 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 810/1611] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:37.863308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3581f9-92c4-40a8-8471-c7f56a2fe35f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:37.865202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2b3581f9-92c4-40a8-8471-c7f56a2fe35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:37.894219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 802/1612] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:37.906631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937b7d5-bd5d-4b16-93c2-bb6762cfc115 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:37.908053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4937b7d5-bd5d-4b16-93c2-bb6762cfc115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:37.954711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3581f9-92c4-40a8-8471-c7f56a2fe35f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:37.960267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9ea9d-e321-44fe-9266-61e3b4a03879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:37.961017 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9ea9d-e321-44fe-9266-61e3b4a03879 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:37.961541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9ea9d-e321-44fe-9266-61e3b4a03879 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:37.961861 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9ea9d-e321-44fe-9266-61e3b4a03879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:37.976032 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9ea9d-e321-44fe-9266-61e3b4a03879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:37.978418 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9ea9d-e321-44fe-9266-61e3b4a03879 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:37.980638 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937b7d5-bd5d-4b16-93c2-bb6762cfc115 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:37.985941 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b296623-2b08-49da-8a87-5b7016ab851f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:37.986569 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b296623-2b08-49da-8a87-5b7016ab851f service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:37.987207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b296623-2b08-49da-8a87-5b7016ab851f service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:37.987313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b296623-2b08-49da-8a87-5b7016ab851f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:37.993165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 811/1613] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:38.005494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b296623-2b08-49da-8a87-5b7016ab851f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:38.015949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b296623-2b08-49da-8a87-5b7016ab851f service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:38.020482 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 803/1614] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:10:38.123276 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9ea9d-e321-44fe-9266-61e3b4a03879 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:38.132968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9ea9d-e321-44fe-9266-61e3b4a03879 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:38.137696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a02d1-955e-42b3-beb1-5e4095a8410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:38.138473 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a02d1-955e-42b3-beb1-5e4095a8410e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:38.138867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a02d1-955e-42b3-beb1-5e4095a8410e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:38.139144 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a02d1-955e-42b3-beb1-5e4095a8410e admin admin] PATH_INFO: `/v3/users/14a61a00fd124d42aba9c7c0131b44f5` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:38.140452 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a02d1-955e-42b3-beb1-5e4095a8410e admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a61a00fd124d42aba9c7c0131b44f5)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:38.142468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a02d1-955e-42b3-beb1-5e4095a8410e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:38.279393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:38.439927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9d2a02d1-955e-42b3-beb1-5e4095a8410e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a61a00fd124d42aba9c7c0131b44f5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:38.440566 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9d2a02d1-955e-42b3-beb1-5e4095a8410e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a61a00fd124d42aba9c7c0131b44f5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:38.454766 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9d2a02d1-955e-42b3-beb1-5e4095a8410e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a61a00fd124d42aba9c7c0131b44f5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:38.455524 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9d2a02d1-955e-42b3-beb1-5e4095a8410e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a61a00fd124d42aba9c7c0131b44f5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:38.461714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b296623-2b08-49da-8a87-5b7016ab851f service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:38.464099 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4b296623-2b08-49da-8a87-5b7016ab851f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:38.488059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b296623-2b08-49da-8a87-5b7016ab851f service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:38.494032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:38.494767 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:38.495042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:38.495312 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] PATH_INFO: `/v3/projects/5ba902056e1945e2816280500cf994b1` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:38.496431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba902056e1945e2816280500cf994b1)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:38.498554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:38.534297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9d2a02d1-955e-42b3-beb1-5e4095a8410e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a61a00fd124d42aba9c7c0131b44f5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:38.548551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 812/1615] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:38 2022] DELETE /identity/v3/users/14a61a00fd124d42aba9c7c0131b44f5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:38.553304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20ace9-bc44-4954-bf75-e85d65f30388 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:38.553672 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20ace9-bc44-4954-bf75-e85d65f30388 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:38.554023 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20ace9-bc44-4954-bf75-e85d65f30388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:38.573885 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-ff20ace9-bc44-4954-bf75-e85d65f30388 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:38.575158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ff20ace9-bc44-4954-bf75-e85d65f30388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:38.636588 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba902056e1945e2816280500cf994b1', 'request_id': 'req-76acf0ee-77bb-420a-99e3-95c82db0036a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:38.638848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 813/1616] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:10:38.648619 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20ace9-bc44-4954-bf75-e85d65f30388 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:38.653408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ff20ace9-bc44-4954-bf75-e85d65f30388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:38.713012 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20ace9-bc44-4954-bf75-e85d65f30388 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:38.734254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba902056e1945e2816280500cf994b1', 'request_id': 'req-76acf0ee-77bb-420a-99e3-95c82db0036a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:38.742574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba902056e1945e2816280500cf994b1', 'request_id': 'req-76acf0ee-77bb-420a-99e3-95c82db0036a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:38.749434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:38.754022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] The token cache is being invalidate because project 5ba902056e1945e2816280500cf994b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:38.754314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:38.755000 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:38.756504 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 804/1617] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:38 2022] DELETE /identity/v3/projects/5ba902056e1945e2816280500cf994b1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:38.761189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:38.763413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:38.767569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:38.773945 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc9b4b-2fed-4dbd-821a-65bb1d4c533d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:38.774550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc9b4b-2fed-4dbd-821a-65bb1d4c533d service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:38.774820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc9b4b-2fed-4dbd-821a-65bb1d4c533d service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:38.775084 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc9b4b-2fed-4dbd-821a-65bb1d4c533d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:38.776897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-64dc9b4b-2fed-4dbd-821a-65bb1d4c533d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:38.833737 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acf0ee-77bb-420a-99e3-95c82db0036a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:38.838406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:38.839040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:38.839321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:38.839597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] PATH_INFO: `/v3/users/3e5ae52a82454d76bdf833f9e9ec664a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:38.841643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5ae52a82454d76bdf833f9e9ec664a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:38.843565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:38.845791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc9b4b-2fed-4dbd-821a-65bb1d4c533d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:38.847700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc9b4b-2fed-4dbd-821a-65bb1d4c533d service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:38.858251 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 814/1618] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:10:39.023314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5ae52a82454d76bdf833f9e9ec664a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:39.024200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5ae52a82454d76bdf833f9e9ec664a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:39.031863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5ae52a82454d76bdf833f9e9ec664a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:39.174671 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5ae52a82454d76bdf833f9e9ec664a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:39.191588 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5ae52a82454d76bdf833f9e9ec664a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:39.200217 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 805/1619] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:38 2022] DELETE /identity/v3/users/3e5ae52a82454d76bdf833f9e9ec664a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:39.337164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc9b4b-2fed-4dbd-821a-65bb1d4c533d service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:39.339027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-64dc9b4b-2fed-4dbd-821a-65bb1d4c533d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:39.351905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc9b4b-2fed-4dbd-821a-65bb1d4c533d service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:39.431403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:39.432040 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:39.432319 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:39.432585 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] PATH_INFO: `/v3/projects/55b34ab067894776a9a408e0a325b36a` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:39.433792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b34ab067894776a9a408e0a325b36a)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:39.435918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:39.579850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b34ab067894776a9a408e0a325b36a', 'request_id': 'req-f30ac502-2b89-4615-bcd7-c029d0cff698'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:39.728739 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b34ab067894776a9a408e0a325b36a', 'request_id': 'req-f30ac502-2b89-4615-bcd7-c029d0cff698'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:39.736537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b34ab067894776a9a408e0a325b36a', 'request_id': 'req-f30ac502-2b89-4615-bcd7-c029d0cff698'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:39.748338 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] The token cache is being invalidate because project 55b34ab067894776a9a408e0a325b36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:39.748651 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:39.749312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:39.754076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 815/1620] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:39 2022] DELETE /identity/v3/projects/55b34ab067894776a9a408e0a325b36a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:39.756898 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:39.760167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:39.777098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d5b3f-43de-41cf-8b3e-820d25dac8d7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:39.846441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d9777-f750-421f-a344-908177d4c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:39.847047 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d9777-f750-421f-a344-908177d4c5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:39.847343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d9777-f750-421f-a344-908177d4c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:39.847623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d9777-f750-421f-a344-908177d4c5cb admin admin] PATH_INFO: `/v3/users/6e735744ecdf461a8cc417dd2197b071` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:39.851369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d9777-f750-421f-a344-908177d4c5cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e735744ecdf461a8cc417dd2197b071)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:39.851369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d9777-f750-421f-a344-908177d4c5cb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:39.875200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:39.971109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:39.973125 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:40.009962 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ac502-2b89-4615-bcd7-c029d0cff698 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:40.028817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:40.029818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:40.030316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:40.030781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] PATH_INFO: `/v3/projects/a7bb7a92a66243a1860853d135039765` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:40.033784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7bb7a92a66243a1860853d135039765)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:40.035917 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:40.078017 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:40.123734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dd4d9777-f750-421f-a344-908177d4c5cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e735744ecdf461a8cc417dd2197b071'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:40.124417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dd4d9777-f750-421f-a344-908177d4c5cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e735744ecdf461a8cc417dd2197b071'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:40.135463 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dd4d9777-f750-421f-a344-908177d4c5cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e735744ecdf461a8cc417dd2197b071'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:40.206390 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7bb7a92a66243a1860853d135039765', 'request_id': 'req-92ce8901-8b62-40df-854f-238c4b70ab0e'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:40.248960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dd4d9777-f750-421f-a344-908177d4c5cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e735744ecdf461a8cc417dd2197b071'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:40.265388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dd4d9777-f750-421f-a344-908177d4c5cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e735744ecdf461a8cc417dd2197b071'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:40.272560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 806/1621] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:39 2022] DELETE /identity/v3/users/6e735744ecdf461a8cc417dd2197b071 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:40.312224 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7bb7a92a66243a1860853d135039765', 'request_id': 'req-92ce8901-8b62-40df-854f-238c4b70ab0e'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:40.321979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7bb7a92a66243a1860853d135039765', 'request_id': 'req-92ce8901-8b62-40df-854f-238c4b70ab0e'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:40.343289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] The token cache is being invalidate because project a7bb7a92a66243a1860853d135039765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:40.344608 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:40.345517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:40.347551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 816/1622] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:39 2022] DELETE /identity/v3/projects/a7bb7a92a66243a1860853d135039765 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:40.352343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91333b4-ad5f-4d77-908e-b1043e3243ca None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:40.352650 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91333b4-ad5f-4d77-908e-b1043e3243ca None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:40.352930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91333b4-ad5f-4d77-908e-b1043e3243ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:40.387574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a91333b4-ad5f-4d77-908e-b1043e3243ca None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:40.390627 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a91333b4-ad5f-4d77-908e-b1043e3243ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:40.448709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:40.458379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:40.566891 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce8901-8b62-40df-854f-238c4b70ab0e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:40.667435 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd80cd-a2c4-4860-a429-d26a77dede3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:40.675862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd80cd-a2c4-4860-a429-d26a77dede3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:40.677132 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd80cd-a2c4-4860-a429-d26a77dede3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:40.677132 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd80cd-a2c4-4860-a429-d26a77dede3d admin admin] PATH_INFO: `/v3/users/e86a6b4a59e14827ae5dc9779dd94b7b` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:40.678899 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd80cd-a2c4-4860-a429-d26a77dede3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e86a6b4a59e14827ae5dc9779dd94b7b)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:40.681240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd80cd-a2c4-4860-a429-d26a77dede3d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:40.747969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 807/1623] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:40.755669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714be3c-5165-4bfb-8684-d29ea9cc77ac None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:40.755954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714be3c-5165-4bfb-8684-d29ea9cc77ac None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:40.756221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714be3c-5165-4bfb-8684-d29ea9cc77ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:40.793260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4714be3c-5165-4bfb-8684-d29ea9cc77ac None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:40.795660 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4714be3c-5165-4bfb-8684-d29ea9cc77ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:40.812157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 808/1624] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:40.814660 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714be3c-5165-4bfb-8684-d29ea9cc77ac None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:40.829751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714be3c-5165-4bfb-8684-d29ea9cc77ac None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:40.835639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60576e6-b110-4f91-9774-eca6a52b2dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:40.836329 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60576e6-b110-4f91-9774-eca6a52b2dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:40.837877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60576e6-b110-4f91-9774-eca6a52b2dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:40.838166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60576e6-b110-4f91-9774-eca6a52b2dc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:40.840125 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60576e6-b110-4f91-9774-eca6a52b2dc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:10:40.840125 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60576e6-b110-4f91-9774-eca6a52b2dc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:40.841361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60576e6-b110-4f91-9774-eca6a52b2dc6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:40.863277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 809/1625] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:10:40.864805 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60576e6-b110-4f91-9774-eca6a52b2dc6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:40.877894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60576e6-b110-4f91-9774-eca6a52b2dc6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:40.883383 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dad3b0-fe8b-4ce5-896b-ebaf4c0d97d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:40.884342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad3b0-fe8b-4ce5-896b-ebaf4c0d97d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:40.885158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad3b0-fe8b-4ce5-896b-ebaf4c0d97d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:40.885478 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dad3b0-fe8b-4ce5-896b-ebaf4c0d97d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:40.886129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dad3b0-fe8b-4ce5-896b-ebaf4c0d97d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:40.889024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dad3b0-fe8b-4ce5-896b-ebaf4c0d97d7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:40.947130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-55fd80cd-a2c4-4860-a429-d26a77dede3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e86a6b4a59e14827ae5dc9779dd94b7b'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:40.948446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-55fd80cd-a2c4-4860-a429-d26a77dede3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e86a6b4a59e14827ae5dc9779dd94b7b'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:40.964598 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-55fd80cd-a2c4-4860-a429-d26a77dede3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e86a6b4a59e14827ae5dc9779dd94b7b'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:40.966672 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-55fd80cd-a2c4-4860-a429-d26a77dede3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e86a6b4a59e14827ae5dc9779dd94b7b'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:41.016718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 810/1626] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:40 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:41.018111 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dad3b0-fe8b-4ce5-896b-ebaf4c0d97d7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:41.020099 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-46dad3b0-fe8b-4ce5-896b-ebaf4c0d97d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:41.054435 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-55fd80cd-a2c4-4860-a429-d26a77dede3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e86a6b4a59e14827ae5dc9779dd94b7b'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:41.058596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:41.079831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 817/1627] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:40 2022] DELETE /identity/v3/users/e86a6b4a59e14827ae5dc9779dd94b7b => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:41.084351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f442-5bdb-4700-b58d-0611a90747c2 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:41.084661 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f442-5bdb-4700-b58d-0611a90747c2 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:41.084931 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f442-5bdb-4700-b58d-0611a90747c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:41.099003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:41.108549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-45b9f442-5bdb-4700-b58d-0611a90747c2 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:41.109830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-45b9f442-5bdb-4700-b58d-0611a90747c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:41.111427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dad3b0-fe8b-4ce5-896b-ebaf4c0d97d7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:41.180649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 818/1628] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:41.181535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f442-5bdb-4700-b58d-0611a90747c2 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:41.183196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-45b9f442-5bdb-4700-b58d-0611a90747c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:41.186990 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c00105-b202-4411-b996-6768938d30d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:41.188274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c00105-b202-4411-b996-6768938d30d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:41.188561 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c00105-b202-4411-b996-6768938d30d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:41.188883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c00105-b202-4411-b996-6768938d30d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:41.189931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c00105-b202-4411-b996-6768938d30d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:41.192715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c00105-b202-4411-b996-6768938d30d0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:41.197544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f442-5bdb-4700-b58d-0611a90747c2 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:41.206261 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:41.207053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:41.207353 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:41.207614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] PATH_INFO: `/v3/projects/987c370341b645b296c01992b899ece1` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:41.208776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=987c370341b645b296c01992b899ece1)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:41.210878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:41.302886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 811/1629] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:41 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:41.304210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c00105-b202-4411-b996-6768938d30d0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:41.307393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-57c00105-b202-4411-b996-6768938d30d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:41.346080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987c370341b645b296c01992b899ece1', 'request_id': 'req-f33bf7fc-9b97-43d9-93bb-fccc40128de7'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:41.384101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c00105-b202-4411-b996-6768938d30d0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:41.432784 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc499555-18bf-45df-99ba-707e1100ab7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:41.433433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc499555-18bf-45df-99ba-707e1100ab7b service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:41.433711 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc499555-18bf-45df-99ba-707e1100ab7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:41.434093 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc499555-18bf-45df-99ba-707e1100ab7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:41.443444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987c370341b645b296c01992b899ece1', 'request_id': 'req-f33bf7fc-9b97-43d9-93bb-fccc40128de7'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:41.451101 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987c370341b645b296c01992b899ece1', 'request_id': 'req-f33bf7fc-9b97-43d9-93bb-fccc40128de7'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:41.461348 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] The token cache is being invalidate because project 987c370341b645b296c01992b899ece1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:41.461631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:41.462283 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:41.463760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 819/1630] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:41 2022] DELETE /identity/v3/projects/987c370341b645b296c01992b899ece1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:41.468672 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:41.470499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:41.499434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc499555-18bf-45df-99ba-707e1100ab7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:41.500884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc499555-18bf-45df-99ba-707e1100ab7b service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:41.510946 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 812/1631] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:41.512377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf38f2-7c6b-4586-946c-ef87d4bf0c47 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:41.512659 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf38f2-7c6b-4586-946c-ef87d4bf0c47 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:41.512925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf38f2-7c6b-4586-946c-ef87d4bf0c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:41.533993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4ecf38f2-7c6b-4586-946c-ef87d4bf0c47 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:41.535099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bf7fc-9b97-43d9-93bb-fccc40128de7 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:41.535242 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4ecf38f2-7c6b-4586-946c-ef87d4bf0c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:41.540199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a14c38-cb87-4899-b9df-161dd93f7fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:41.540789 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a14c38-cb87-4899-b9df-161dd93f7fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:41.541060 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a14c38-cb87-4899-b9df-161dd93f7fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:41.541387 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a14c38-cb87-4899-b9df-161dd93f7fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:41.542030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a14c38-cb87-4899-b9df-161dd93f7fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:41.544227 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a14c38-cb87-4899-b9df-161dd93f7fe1 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:41.544770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 813/1632] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:41.552560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd904c-b673-4c94-bec5-8a4388a29c52 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:41.552794 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd904c-b673-4c94-bec5-8a4388a29c52 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:41.553068 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd904c-b673-4c94-bec5-8a4388a29c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:41.563929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 820/1633] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:41.568377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a14c38-cb87-4899-b9df-161dd93f7fe1 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:41.574704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-78fd904c-b673-4c94-bec5-8a4388a29c52 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:41.576548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-78fd904c-b673-4c94-bec5-8a4388a29c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:41.579195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a14c38-cb87-4899-b9df-161dd93f7fe1 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:41.584559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc7912-660f-44d2-8902-8b8af7dd8e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:41.585554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 814/1634] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:41.585704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc7912-660f-44d2-8902-8b8af7dd8e2e admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:41.585929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc7912-660f-44d2-8902-8b8af7dd8e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:41.586262 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc7912-660f-44d2-8902-8b8af7dd8e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:41.586951 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc7912-660f-44d2-8902-8b8af7dd8e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:41.588637 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc7912-660f-44d2-8902-8b8af7dd8e2e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:41.589865 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd904c-b673-4c94-bec5-8a4388a29c52 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:41.601784 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd904c-b673-4c94-bec5-8a4388a29c52 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:41.601933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 821/1635] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:41.604967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc7912-660f-44d2-8902-8b8af7dd8e2e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:41.608977 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f39097-88bc-4d29-9af7-47975f343b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:41.609843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39097-88bc-4d29-9af7-47975f343b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:41.610103 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39097-88bc-4d29-9af7-47975f343b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:41.610438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39097-88bc-4d29-9af7-47975f343b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:41.611521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f39097-88bc-4d29-9af7-47975f343b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:10:41.611947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f39097-88bc-4d29-9af7-47975f343b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:41.614655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f39097-88bc-4d29-9af7-47975f343b20 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:41.616277 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc7912-660f-44d2-8902-8b8af7dd8e2e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:41.621904 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57a3ae-ba5e-45b9-b76d-81ce0b6973f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:41.622624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57a3ae-ba5e-45b9-b76d-81ce0b6973f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:41.623305 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57a3ae-ba5e-45b9-b76d-81ce0b6973f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:41.623305 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57a3ae-ba5e-45b9-b76d-81ce0b6973f1 admin admin] PATH_INFO: `/v3/projects/6fadc645affe416fae4b650c5ff5f26c/users/6de3a3a065344510b90efbdcd2368191/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:41.629457 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 815/1636] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:10:41.632858 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f39097-88bc-4d29-9af7-47975f343b20 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:41.641678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57a3ae-ba5e-45b9-b76d-81ce0b6973f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fadc645affe416fae4b650c5ff5f26c, user_id=6de3a3a065344510b90efbdcd2368191, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:41.644359 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57a3ae-ba5e-45b9-b76d-81ce0b6973f1 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:41.644886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f39097-88bc-4d29-9af7-47975f343b20 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:41.649595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413cf8d-c1e3-432e-86e4-1235ba540d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:41.650194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413cf8d-c1e3-432e-86e4-1235ba540d3b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:41.650468 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413cf8d-c1e3-432e-86e4-1235ba540d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:41.650736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413cf8d-c1e3-432e-86e4-1235ba540d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:41.651490 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413cf8d-c1e3-432e-86e4-1235ba540d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:41.654019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413cf8d-c1e3-432e-86e4-1235ba540d3b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:41.822549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 822/1637] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:41 2022] PUT /identity/v3/projects/6fadc645affe416fae4b650c5ff5f26c/users/6de3a3a065344510b90efbdcd2368191/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:41.834287 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 816/1638] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:41 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:41.834943 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51fcb-6022-4c41-8f45-64e6598049b3 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:41.842512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51fcb-6022-4c41-8f45-64e6598049b3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:41.842512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f51fcb-6022-4c41-8f45-64e6598049b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:41.845485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413cf8d-c1e3-432e-86e4-1235ba540d3b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:41.866035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-99f51fcb-6022-4c41-8f45-64e6598049b3 None None] MFA Rules not processed for user `6de3a3a065344510b90efbdcd2368191`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:41.867874 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-99f51fcb-6022-4c41-8f45-64e6598049b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:41.924433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413cf8d-c1e3-432e-86e4-1235ba540d3b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:41.933769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c407706-caf0-4553-9ce5-91b4e30eda0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:41.935339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c407706-caf0-4553-9ce5-91b4e30eda0c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:41.939840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c407706-caf0-4553-9ce5-91b4e30eda0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:41.939840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c407706-caf0-4553-9ce5-91b4e30eda0c admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:41.939840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c407706-caf0-4553-9ce5-91b4e30eda0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:41.939840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c407706-caf0-4553-9ce5-91b4e30eda0c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:41.965611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 823/1639] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:41.985866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f51fcb-6022-4c41-8f45-64e6598049b3 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:41.987484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-99f51fcb-6022-4c41-8f45-64e6598049b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:42.075952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 817/1640] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:41 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:42.077156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c407706-caf0-4553-9ce5-91b4e30eda0c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:42.086309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f51fcb-6022-4c41-8f45-64e6598049b3 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:42.088303 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c407706-caf0-4553-9ce5-91b4e30eda0c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:42.090716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f98fe-92af-43e5-897a-f9bf43b84049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:42.091350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f98fe-92af-43e5-897a-f9bf43b84049 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:42.091630 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f98fe-92af-43e5-897a-f9bf43b84049 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:42.095889 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f98fe-92af-43e5-897a-f9bf43b84049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:42.096108 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af244ea0-6904-4536-838f-37bc74466d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:42.096705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af244ea0-6904-4536-838f-37bc74466d71 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:42.097112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af244ea0-6904-4536-838f-37bc74466d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:42.097682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af244ea0-6904-4536-838f-37bc74466d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:42.098563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af244ea0-6904-4536-838f-37bc74466d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:42.100378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af244ea0-6904-4536-838f-37bc74466d71 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:42.105177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f98fe-92af-43e5-897a-f9bf43b84049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:42.107883 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f98fe-92af-43e5-897a-f9bf43b84049 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:42.113801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 818/1641] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:42.117786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af244ea0-6904-4536-838f-37bc74466d71 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:42.120054 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 824/1642] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:42.131139 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af244ea0-6904-4536-838f-37bc74466d71 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:42.136758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565a780-6d00-455e-a18a-14e5ee666fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:42.137757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565a780-6d00-455e-a18a-14e5ee666fdd admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:42.138178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565a780-6d00-455e-a18a-14e5ee666fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:42.138438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565a780-6d00-455e-a18a-14e5ee666fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:42.139252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565a780-6d00-455e-a18a-14e5ee666fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:42.140896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565a780-6d00-455e-a18a-14e5ee666fdd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:42.165338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 819/1643] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:42.167403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f98fe-92af-43e5-897a-f9bf43b84049 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:42.180174 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f98fe-92af-43e5-897a-f9bf43b84049 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:42.185473 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64ba6e-7635-4c2d-bad0-478fe2c1e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:42.186445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64ba6e-7635-4c2d-bad0-478fe2c1e033 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:42.187765 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64ba6e-7635-4c2d-bad0-478fe2c1e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:42.187765 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64ba6e-7635-4c2d-bad0-478fe2c1e033 admin admin] PATH_INFO: `/v3/projects/af9a0de8d09d4a758f999bc3cae4527f/users/f1723048a89544ad8d9c09de0f00d895/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:42.217643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64ba6e-7635-4c2d-bad0-478fe2c1e033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9a0de8d09d4a758f999bc3cae4527f, user_id=f1723048a89544ad8d9c09de0f00d895, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:42.217643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64ba6e-7635-4c2d-bad0-478fe2c1e033 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:42.495453 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 825/1644] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:42 2022] PUT /identity/v3/projects/af9a0de8d09d4a758f999bc3cae4527f/users/f1723048a89544ad8d9c09de0f00d895/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:42.506335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565a780-6d00-455e-a18a-14e5ee666fdd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:42.508971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c565a780-6d00-455e-a18a-14e5ee666fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:42.511635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bb4bf-1a16-4190-b805-34ddf524528c None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:42.512670 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bb4bf-1a16-4190-b805-34ddf524528c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:42.513108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bb4bf-1a16-4190-b805-34ddf524528c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:42.523749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565a780-6d00-455e-a18a-14e5ee666fdd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:42.545818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-526bb4bf-1a16-4190-b805-34ddf524528c None None] MFA Rules not processed for user `f1723048a89544ad8d9c09de0f00d895`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:42.547628 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-526bb4bf-1a16-4190-b805-34ddf524528c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:42.595182 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:42.595827 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:42.596104 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:42.596379 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af admin admin] PATH_INFO: `/v3/projects/cbe91bcc191a4107aac9797e362f1e3e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:42.597568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe91bcc191a4107aac9797e362f1e3e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:42.599600 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:42.616820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 826/1645] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:42.621892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bb4bf-1a16-4190-b805-34ddf524528c None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:42.638240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bb4bf-1a16-4190-b805-34ddf524528c None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:42.643239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322801c-d39e-44c2-8e8c-15a56d8cd6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:42.644040 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322801c-d39e-44c2-8e8c-15a56d8cd6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:42.644490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322801c-d39e-44c2-8e8c-15a56d8cd6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:42.644830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322801c-d39e-44c2-8e8c-15a56d8cd6b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:42.645560 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322801c-d39e-44c2-8e8c-15a56d8cd6b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:42.654439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322801c-d39e-44c2-8e8c-15a56d8cd6b2 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:42.776096 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe91bcc191a4107aac9797e362f1e3e', 'request_id': 'req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:42.815614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:42.834978 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 827/1646] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:42 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:10:42.835784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322801c-d39e-44c2-8e8c-15a56d8cd6b2 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:42.866615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe91bcc191a4107aac9797e362f1e3e', 'request_id': 'req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:42.875175 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe91bcc191a4107aac9797e362f1e3e', 'request_id': 'req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:42.892304 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af admin admin] The token cache is being invalidate because project cbe91bcc191a4107aac9797e362f1e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:42.892304 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:42.893180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45628a63-a8fd-47d5-94a8-5ea6aec2c7af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:42.899426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 820/1647] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:42 2022] DELETE /identity/v3/projects/cbe91bcc191a4107aac9797e362f1e3e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:42.900955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9eca2-d0e2-4202-89bc-47d1bd67a4a8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:42.901332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9eca2-d0e2-4202-89bc-47d1bd67a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:42.901549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9eca2-d0e2-4202-89bc-47d1bd67a4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:42.919761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322801c-d39e-44c2-8e8c-15a56d8cd6b2 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:42.924615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c3f9eca2-d0e2-4202-89bc-47d1bd67a4a8 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:42.924737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c920c5-cba9-46a4-9aa4-eb82116e3f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:42.925146 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c920c5-cba9-46a4-9aa4-eb82116e3f77 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:42.925483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c920c5-cba9-46a4-9aa4-eb82116e3f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:42.925750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c920c5-cba9-46a4-9aa4-eb82116e3f77 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:42.925859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c3f9eca2-d0e2-4202-89bc-47d1bd67a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:42.926629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c920c5-cba9-46a4-9aa4-eb82116e3f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:42.928695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c920c5-cba9-46a4-9aa4-eb82116e3f77 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:42.937335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 821/1648] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:42.953337 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697de4d4-030e-40c5-96aa-319d86bc1414 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:42.953639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697de4d4-030e-40c5-96aa-319d86bc1414 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:42.954156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697de4d4-030e-40c5-96aa-319d86bc1414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:42.958246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:42.976883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-697de4d4-030e-40c5-96aa-319d86bc1414 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:42.978164 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-697de4d4-030e-40c5-96aa-319d86bc1414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:42.986013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 822/1649] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:10:42.990084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697de4d4-030e-40c5-96aa-319d86bc1414 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:42.999479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697de4d4-030e-40c5-96aa-319d86bc1414 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:43.003983 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca444d78-aa83-44e2-ab20-13770dcb83c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:43.004554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca444d78-aa83-44e2-ab20-13770dcb83c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:43.004832 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca444d78-aa83-44e2-ab20-13770dcb83c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:43.005098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca444d78-aa83-44e2-ab20-13770dcb83c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:43.005790 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca444d78-aa83-44e2-ab20-13770dcb83c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:10:43.006108 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca444d78-aa83-44e2-ab20-13770dcb83c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:43.007643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca444d78-aa83-44e2-ab20-13770dcb83c4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:43.020067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 823/1650] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:10:43.027311 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca444d78-aa83-44e2-ab20-13770dcb83c4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:43.037334 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca444d78-aa83-44e2-ab20-13770dcb83c4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:43.042021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c787ad-08f6-47a1-bb0d-371866772e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:43.042615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c787ad-08f6-47a1-bb0d-371866772e00 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:43.042891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c787ad-08f6-47a1-bb0d-371866772e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:43.043489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c787ad-08f6-47a1-bb0d-371866772e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:43.044203 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c787ad-08f6-47a1-bb0d-371866772e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:43.046165 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c787ad-08f6-47a1-bb0d-371866772e00 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:43.061000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 828/1651] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:42 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:43.061000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c920c5-cba9-46a4-9aa4-eb82116e3f77 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:43.064074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-38c920c5-cba9-46a4-9aa4-eb82116e3f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:43.078209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c920c5-cba9-46a4-9aa4-eb82116e3f77 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:43.083146 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5938d-3515-43ca-94f4-41e3eb43e206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:43.083769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5938d-3515-43ca-94f4-41e3eb43e206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:43.084120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5938d-3515-43ca-94f4-41e3eb43e206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:43.084331 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5938d-3515-43ca-94f4-41e3eb43e206 admin admin] PATH_INFO: `/v3/users/7f915ab5fe6b4ec1a82b7cc7e62427b5` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:43.085733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5938d-3515-43ca-94f4-41e3eb43e206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f915ab5fe6b4ec1a82b7cc7e62427b5)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:43.087611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5938d-3515-43ca-94f4-41e3eb43e206 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:43.271292 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 824/1652] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:43 2022] POST /identity/v3/projects => generated 389 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:10:43.271292 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c787ad-08f6-47a1-bb0d-371866772e00 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:43.274310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-18c787ad-08f6-47a1-bb0d-371866772e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:43.347405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c787ad-08f6-47a1-bb0d-371866772e00 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:43.352135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dff13-84f2-4bab-95d1-42d22e48bf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:43.352739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dff13-84f2-4bab-95d1-42d22e48bf99 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:43.353019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dff13-84f2-4bab-95d1-42d22e48bf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:43.353311 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dff13-84f2-4bab-95d1-42d22e48bf99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:43.353963 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618dff13-84f2-4bab-95d1-42d22e48bf99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:43.355577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618dff13-84f2-4bab-95d1-42d22e48bf99 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:43.365840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 825/1653] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:43.366787 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dff13-84f2-4bab-95d1-42d22e48bf99 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:43.376789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dff13-84f2-4bab-95d1-42d22e48bf99 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:43.381481 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2777f8-5d1f-4acf-964f-e643f66af1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:43.382052 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2777f8-5d1f-4acf-964f-e643f66af1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:43.382332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2777f8-5d1f-4acf-964f-e643f66af1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:43.383585 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2777f8-5d1f-4acf-964f-e643f66af1f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:43.383585 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2777f8-5d1f-4acf-964f-e643f66af1f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:43.385399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2777f8-5d1f-4acf-964f-e643f66af1f2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:43.422434 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-46c5938d-3515-43ca-94f4-41e3eb43e206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f915ab5fe6b4ec1a82b7cc7e62427b5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:43.423387 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-46c5938d-3515-43ca-94f4-41e3eb43e206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f915ab5fe6b4ec1a82b7cc7e62427b5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:43.436520 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-46c5938d-3515-43ca-94f4-41e3eb43e206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f915ab5fe6b4ec1a82b7cc7e62427b5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:43.437419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-46c5938d-3515-43ca-94f4-41e3eb43e206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f915ab5fe6b4ec1a82b7cc7e62427b5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:43.495159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 826/1654] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:43 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:43.496057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2777f8-5d1f-4acf-964f-e643f66af1f2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:43.498783 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0f2777f8-5d1f-4acf-964f-e643f66af1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:43.510632 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2777f8-5d1f-4acf-964f-e643f66af1f2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:43.515292 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e39b9-c4f2-4ea7-be6d-10d65bc416a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:43.515895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e39b9-c4f2-4ea7-be6d-10d65bc416a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:43.516171 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e39b9-c4f2-4ea7-be6d-10d65bc416a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:43.516448 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e39b9-c4f2-4ea7-be6d-10d65bc416a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:43.517086 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e39b9-c4f2-4ea7-be6d-10d65bc416a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:43.518696 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e39b9-c4f2-4ea7-be6d-10d65bc416a1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:43.529505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 827/1655] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:43.530305 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e39b9-c4f2-4ea7-be6d-10d65bc416a1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:43.531918 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1b3e39b9-c4f2-4ea7-be6d-10d65bc416a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:43.545879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e39b9-c4f2-4ea7-be6d-10d65bc416a1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:43.550569 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a18d57-e39f-4af9-b9dd-d6b9c8dcdee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:43.551416 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a18d57-e39f-4af9-b9dd-d6b9c8dcdee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:43.551690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a18d57-e39f-4af9-b9dd-d6b9c8dcdee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:43.551958 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a18d57-e39f-4af9-b9dd-d6b9c8dcdee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:43.552593 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a18d57-e39f-4af9-b9dd-d6b9c8dcdee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:43.554205 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a18d57-e39f-4af9-b9dd-d6b9c8dcdee4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:43.562603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-46c5938d-3515-43ca-94f4-41e3eb43e206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f915ab5fe6b4ec1a82b7cc7e62427b5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:43.565631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 828/1656] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:43.566184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a18d57-e39f-4af9-b9dd-d6b9c8dcdee4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:43.576117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 829/1657] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:43 2022] DELETE /identity/v3/users/7f915ab5fe6b4ec1a82b7cc7e62427b5 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:43.576673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a18d57-e39f-4af9-b9dd-d6b9c8dcdee4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:43.581577 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5938d-3515-43ca-94f4-41e3eb43e206 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:43.649915 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa58d5-439e-4ec4-8614-84d077077358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:43.650840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa58d5-439e-4ec4-8614-84d077077358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:43.651391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa58d5-439e-4ec4-8614-84d077077358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:43.651517 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa58d5-439e-4ec4-8614-84d077077358 admin admin] PATH_INFO: `/v3/projects/8ee767a04b284a0a91e6cb587cbb06da/users/1d281ca411704ab08b8c788d65016416/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:43.661844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5938d-3515-43ca-94f4-41e3eb43e206 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:43.667129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf0cb5-a57a-40ed-8360-22b418abecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:43.667767 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0cb5-a57a-40ed-8360-22b418abecbe admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:43.668042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0cb5-a57a-40ed-8360-22b418abecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:43.676486 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0cb5-a57a-40ed-8360-22b418abecbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:43.676486 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf0cb5-a57a-40ed-8360-22b418abecbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:43.676486 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf0cb5-a57a-40ed-8360-22b418abecbe admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:43.676943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa58d5-439e-4ec4-8614-84d077077358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee767a04b284a0a91e6cb587cbb06da, user_id=1d281ca411704ab08b8c788d65016416, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:43.676943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa58d5-439e-4ec4-8614-84d077077358 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:43.686386 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 830/1658] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:43.687875 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf0cb5-a57a-40ed-8360-22b418abecbe admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:43.697853 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf0cb5-a57a-40ed-8360-22b418abecbe admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:43.702706 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99017d0b-7b2c-4169-9e5d-eb31c08650af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:43.703473 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99017d0b-7b2c-4169-9e5d-eb31c08650af admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:43.703770 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99017d0b-7b2c-4169-9e5d-eb31c08650af admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:43.704035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99017d0b-7b2c-4169-9e5d-eb31c08650af admin admin] PATH_INFO: `/v3/projects/9a142f79891949219b15ac68e9d6f762/users/8b2a79f22cec449bbc35004184540b93/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:43.720730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99017d0b-7b2c-4169-9e5d-eb31c08650af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a142f79891949219b15ac68e9d6f762, user_id=8b2a79f22cec449bbc35004184540b93, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:43.723443 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99017d0b-7b2c-4169-9e5d-eb31c08650af admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:43.797199 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 829/1659] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:43 2022] PUT /identity/v3/projects/8ee767a04b284a0a91e6cb587cbb06da/users/1d281ca411704ab08b8c788d65016416/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:43.808509 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c6e4-0264-4e2e-bfbc-3fbc9d516b88 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:43.808854 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c6e4-0264-4e2e-bfbc-3fbc9d516b88 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:43.809122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c6e4-0264-4e2e-bfbc-3fbc9d516b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:43.838160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3033c6e4-0264-4e2e-bfbc-3fbc9d516b88 None None] MFA Rules not processed for user `1d281ca411704ab08b8c788d65016416`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:43.839383 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3033c6e4-0264-4e2e-bfbc-3fbc9d516b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:43.884087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 831/1660] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:43 2022] PUT /identity/v3/projects/9a142f79891949219b15ac68e9d6f762/users/8b2a79f22cec449bbc35004184540b93/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:43.901006 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04ffd2-98da-4f91-ba39-20a4d81fc5e1 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:43.901443 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04ffd2-98da-4f91-ba39-20a4d81fc5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:43.901863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04ffd2-98da-4f91-ba39-20a4d81fc5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:43.907230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 830/1661] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:10:43.912002 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c6e4-0264-4e2e-bfbc-3fbc9d516b88 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:43.936909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-9e04ffd2-98da-4f91-ba39-20a4d81fc5e1 None None] MFA Rules not processed for user `8b2a79f22cec449bbc35004184540b93`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:43.938396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9e04ffd2-98da-4f91-ba39-20a4d81fc5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:43.993430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c6e4-0264-4e2e-bfbc-3fbc9d516b88 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:44.026698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 832/1662] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:44.027488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04ffd2-98da-4f91-ba39-20a4d81fc5e1 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:44.029562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9e04ffd2-98da-4f91-ba39-20a4d81fc5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:44.066600 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36474d64-9cf2-43ed-8990-dd2eeab23549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:44.067217 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474d64-9cf2-43ed-8990-dd2eeab23549 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.067495 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474d64-9cf2-43ed-8990-dd2eeab23549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.067765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36474d64-9cf2-43ed-8990-dd2eeab23549 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.068402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36474d64-9cf2-43ed-8990-dd2eeab23549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:44.070342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36474d64-9cf2-43ed-8990-dd2eeab23549 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:44.114918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04ffd2-98da-4f91-ba39-20a4d81fc5e1 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:44.120769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:44.121873 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.122553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.122833 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8 admin admin] PATH_INFO: `/v3/projects/cd9c311deda54ddf9eac5bec33176932` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.124311 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9c311deda54ddf9eac5bec33176932)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:44.127261 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:44.202225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 831/1663] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:43 2022] POST /identity/v3/projects => generated 379 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:10:44.203132 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36474d64-9cf2-43ed-8990-dd2eeab23549 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:44.204723 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-36474d64-9cf2-43ed-8990-dd2eeab23549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:44.267743 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36474d64-9cf2-43ed-8990-dd2eeab23549 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:44.271464 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76400755-2795-4c5e-a433-d70f613e5e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:44.272078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76400755-2795-4c5e-a433-d70f613e5e82 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.272466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76400755-2795-4c5e-a433-d70f613e5e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.272745 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76400755-2795-4c5e-a433-d70f613e5e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.297794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9c311deda54ddf9eac5bec33176932', 'request_id': 'req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:44.348451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76400755-2795-4c5e-a433-d70f613e5e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:44.350045 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76400755-2795-4c5e-a433-d70f613e5e82 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:44.364313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 832/1664] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:44.365435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76400755-2795-4c5e-a433-d70f613e5e82 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:44.421519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9c311deda54ddf9eac5bec33176932', 'request_id': 'req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:44.426983 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9c311deda54ddf9eac5bec33176932', 'request_id': 'req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:44.443395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8 admin admin] The token cache is being invalidate because project cd9c311deda54ddf9eac5bec33176932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:44.443747 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:44.444821 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e80a0512-f56d-4c6e-bd6b-7f189dedbdf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:44.447190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 833/1665] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:44 2022] DELETE /identity/v3/projects/cd9c311deda54ddf9eac5bec33176932 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:44.453204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199c62-6cbb-4039-b90a-26729ef8f767 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.453521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199c62-6cbb-4039-b90a-26729ef8f767 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.458745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199c62-6cbb-4039-b90a-26729ef8f767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.467977 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76400755-2795-4c5e-a433-d70f613e5e82 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:44.474617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-97199c62-6cbb-4039-b90a-26729ef8f767 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:44.475964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-97199c62-6cbb-4039-b90a-26729ef8f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:44.531451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3eba6-1414-4358-a0be-756964d67b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:44.531961 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3eba6-1414-4358-a0be-756964d67b73 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.532541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3eba6-1414-4358-a0be-756964d67b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.532836 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3eba6-1414-4358-a0be-756964d67b73 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.533786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3eba6-1414-4358-a0be-756964d67b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:44.535741 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3eba6-1414-4358-a0be-756964d67b73 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:44.546009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 834/1666] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:10:44.553689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f5fb9-abb3-4d4e-95d5-d9a62dc990b4 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.554002 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f5fb9-abb3-4d4e-95d5-d9a62dc990b4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.554274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f5fb9-abb3-4d4e-95d5-d9a62dc990b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.575237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-1d2f5fb9-abb3-4d4e-95d5-d9a62dc990b4 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:44.576419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-1d2f5fb9-abb3-4d4e-95d5-d9a62dc990b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:44.584247 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 835/1667] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:10:44.588232 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f5fb9-abb3-4d4e-95d5-d9a62dc990b4 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:44.597377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f5fb9-abb3-4d4e-95d5-d9a62dc990b4 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:44.602323 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d816dc-c937-42bc-bbe0-6bb44e6d014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:44.603126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:44.603283 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d816dc-c937-42bc-bbe0-6bb44e6d014b admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.603396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d816dc-c937-42bc-bbe0-6bb44e6d014b admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.603653 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d816dc-c937-42bc-bbe0-6bb44e6d014b admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.604290 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d816dc-c937-42bc-bbe0-6bb44e6d014b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:10:44.604633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d816dc-c937-42bc-bbe0-6bb44e6d014b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:44.606674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d816dc-c937-42bc-bbe0-6bb44e6d014b admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:44.610433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 833/1668] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:44 2022] POST /identity/v3/users => generated 296 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:44.614547 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3eba6-1414-4358-a0be-756964d67b73 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:44.616362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7ac3eba6-1414-4358-a0be-756964d67b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:44.621800 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 836/1669] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:10:44.624658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d816dc-c937-42bc-bbe0-6bb44e6d014b admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:44.629229 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3eba6-1414-4358-a0be-756964d67b73 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:44.634442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801aa43-a7de-463f-b8bb-aeabd4696bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:44.634613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d816dc-c937-42bc-bbe0-6bb44e6d014b admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:44.635284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801aa43-a7de-463f-b8bb-aeabd4696bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.635493 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801aa43-a7de-463f-b8bb-aeabd4696bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.635767 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801aa43-a7de-463f-b8bb-aeabd4696bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.636418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801aa43-a7de-463f-b8bb-aeabd4696bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:44.638660 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801aa43-a7de-463f-b8bb-aeabd4696bd6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:44.639849 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499f706-8f84-4503-ada4-2bbc29e1faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:44.640437 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f706-8f84-4503-ada4-2bbc29e1faa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.640710 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f706-8f84-4503-ada4-2bbc29e1faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.640975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f706-8f84-4503-ada4-2bbc29e1faa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.641650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499f706-8f84-4503-ada4-2bbc29e1faa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:44.643507 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499f706-8f84-4503-ada4-2bbc29e1faa6 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:44.651030 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 834/1670] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:10:44.655662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801aa43-a7de-463f-b8bb-aeabd4696bd6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:44.666262 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801aa43-a7de-463f-b8bb-aeabd4696bd6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:44.670947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1884669-0405-4e90-8b2a-8fcb31574f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:44.671620 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1884669-0405-4e90-8b2a-8fcb31574f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.671894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1884669-0405-4e90-8b2a-8fcb31574f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.673506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1884669-0405-4e90-8b2a-8fcb31574f18 admin admin] PATH_INFO: `/v3/projects/577c5b0520874b17bea2b3596e5c039b/users/760c095c9a1244eba689c05a81f34470/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.687563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1884669-0405-4e90-8b2a-8fcb31574f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577c5b0520874b17bea2b3596e5c039b, user_id=760c095c9a1244eba689c05a81f34470, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:44.690224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1884669-0405-4e90-8b2a-8fcb31574f18 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:44.730037 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 837/1671] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:44 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:10:44.734473 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499f706-8f84-4503-ada4-2bbc29e1faa6 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:44.757440 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 835/1672] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:44 2022] PUT /identity/v3/projects/577c5b0520874b17bea2b3596e5c039b/users/760c095c9a1244eba689c05a81f34470/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:44.761247 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1884669-0405-4e90-8b2a-8fcb31574f18 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:44.796869 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499f706-8f84-4503-ada4-2bbc29e1faa6 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:44.829538 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1884669-0405-4e90-8b2a-8fcb31574f18 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:44.836161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088b257-00b2-47aa-b6bc-f5320c7ad63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:44.836979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088b257-00b2-47aa-b6bc-f5320c7ad63e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.837256 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088b257-00b2-47aa-b6bc-f5320c7ad63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.837561 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088b257-00b2-47aa-b6bc-f5320c7ad63e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.838206 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088b257-00b2-47aa-b6bc-f5320c7ad63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:44.839796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088b257-00b2-47aa-b6bc-f5320c7ad63e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:44.851009 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 836/1673] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:10:44.854975 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088b257-00b2-47aa-b6bc-f5320c7ad63e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:44.860063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0b653-9e75-4924-946e-34504939d473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:44.864705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b653-9e75-4924-946e-34504939d473 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.864705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b653-9e75-4924-946e-34504939d473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.864705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0b653-9e75-4924-946e-34504939d473 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.864705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0b653-9e75-4924-946e-34504939d473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:44.864705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0b653-9e75-4924-946e-34504939d473 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:44.866538 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088b257-00b2-47aa-b6bc-f5320c7ad63e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:44.872256 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194976-b4c8-464b-b0e9-5f8e9d3f867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:44.872895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194976-b4c8-464b-b0e9-5f8e9d3f867e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.873173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194976-b4c8-464b-b0e9-5f8e9d3f867e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.873487 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194976-b4c8-464b-b0e9-5f8e9d3f867e admin admin] PATH_INFO: `/v3/projects/577c5b0520874b17bea2b3596e5c039b/users/760c095c9a1244eba689c05a81f34470/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.875578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6194976-b4c8-464b-b0e9-5f8e9d3f867e admin admin] RBAC: Authorizing `identity:create_grant(project_id=577c5b0520874b17bea2b3596e5c039b, user_id=760c095c9a1244eba689c05a81f34470, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:44.878319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6194976-b4c8-464b-b0e9-5f8e9d3f867e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:44.890152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 837/1674] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:44 2022] PUT /identity/v3/projects/577c5b0520874b17bea2b3596e5c039b/users/760c095c9a1244eba689c05a81f34470/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:44.900590 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0779d1-6574-4132-8548-5e4a044f61c6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:44.900869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0779d1-6574-4132-8548-5e4a044f61c6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:44.901138 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0779d1-6574-4132-8548-5e4a044f61c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:44.929078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cc0779d1-6574-4132-8548-5e4a044f61c6 None None] MFA Rules not processed for user `760c095c9a1244eba689c05a81f34470`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:44.930294 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cc0779d1-6574-4132-8548-5e4a044f61c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:44.963155 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 838/1675] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:44 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:10:44.967923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0b653-9e75-4924-946e-34504939d473 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:44.978021 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0b653-9e75-4924-946e-34504939d473 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:45.027131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 838/1676] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:10:45.035610 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0779d1-6574-4132-8548-5e4a044f61c6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:45.037494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cc0779d1-6574-4132-8548-5e4a044f61c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:45.041887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1674-2156-4863-9a59-ea171a9a9b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:45.042547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1674-2156-4863-9a59-ea171a9a9b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:45.042886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1674-2156-4863-9a59-ea171a9a9b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:45.043782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1674-2156-4863-9a59-ea171a9a9b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:45.044781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b1674-2156-4863-9a59-ea171a9a9b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:45.047251 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b1674-2156-4863-9a59-ea171a9a9b59 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:45.053462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:45.064479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 839/1677] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:45.068346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1674-2156-4863-9a59-ea171a9a9b59 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:45.079117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1674-2156-4863-9a59-ea171a9a9b59 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:45.089155 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8063e-ec7b-47fc-b62c-671a90714a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:45.095561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8063e-ec7b-47fc-b62c-671a90714a58 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:45.095561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8063e-ec7b-47fc-b62c-671a90714a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:45.095561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8063e-ec7b-47fc-b62c-671a90714a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:45.095561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8063e-ec7b-47fc-b62c-671a90714a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:45.095561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8063e-ec7b-47fc-b62c-671a90714a58 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:45.101914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0779d1-6574-4132-8548-5e4a044f61c6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:45.104599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 840/1678] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:10:45.106457 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75be20-a9c2-4b73-8a0d-f256416e4c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:45.107142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75be20-a9c2-4b73-8a0d-f256416e4c41 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:45.107423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75be20-a9c2-4b73-8a0d-f256416e4c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:45.107696 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75be20-a9c2-4b73-8a0d-f256416e4c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:45.109679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8063e-ec7b-47fc-b62c-671a90714a58 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:45.120895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75be20-a9c2-4b73-8a0d-f256416e4c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:45.120895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75be20-a9c2-4b73-8a0d-f256416e4c41 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:45.127378 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8063e-ec7b-47fc-b62c-671a90714a58 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:45.129781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc05334-b5a2-428f-b76a-1073183bd813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:45.130602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc05334-b5a2-428f-b76a-1073183bd813 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:45.131046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc05334-b5a2-428f-b76a-1073183bd813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:45.131456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc05334-b5a2-428f-b76a-1073183bd813 admin admin] PATH_INFO: `/v3/projects/8e1688a912164f1fb1e5748f465574a7/users/3d3801003e2048979568dd6be8c9d180/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:45.133697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 839/1679] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:45.148114 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc05334-b5a2-428f-b76a-1073183bd813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1688a912164f1fb1e5748f465574a7, user_id=3d3801003e2048979568dd6be8c9d180, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:45.151067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc05334-b5a2-428f-b76a-1073183bd813 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:45.360700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75be20-a9c2-4b73-8a0d-f256416e4c41 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:45.362163 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ab75be20-a9c2-4b73-8a0d-f256416e4c41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:45.373553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75be20-a9c2-4b73-8a0d-f256416e4c41 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:45.377172 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea559cb-5de7-468c-a17f-2411412ce809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:45.377796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea559cb-5de7-468c-a17f-2411412ce809 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:45.378120 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea559cb-5de7-468c-a17f-2411412ce809 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:45.378423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea559cb-5de7-468c-a17f-2411412ce809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:45.380152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7ea559cb-5de7-468c-a17f-2411412ce809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:45.438933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea559cb-5de7-468c-a17f-2411412ce809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:45.440358 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea559cb-5de7-468c-a17f-2411412ce809 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:45.456694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 840/1680] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:10:45.469839 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 841/1681] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:45 2022] PUT /identity/v3/projects/8e1688a912164f1fb1e5748f465574a7/users/3d3801003e2048979568dd6be8c9d180/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:45.474975 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed51b5-84ca-483f-a7d6-373b42c192e3 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:45.475385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed51b5-84ca-483f-a7d6-373b42c192e3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:45.475777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed51b5-84ca-483f-a7d6-373b42c192e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:45.513121 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-39ed51b5-84ca-483f-a7d6-373b42c192e3 None None] MFA Rules not processed for user `3d3801003e2048979568dd6be8c9d180`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:45.514545 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-39ed51b5-84ca-483f-a7d6-373b42c192e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:45.592727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 841/1682] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:45.605381 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc05334-b5a2-428f-b76a-1073183bd813 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:45.607270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-1dc05334-b5a2-428f-b76a-1073183bd813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:45.671774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:45.693518 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc05334-b5a2-428f-b76a-1073183bd813 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:45.700745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148d6d-d8b0-4e1c-8786-17ef7aec7373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:45.701380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148d6d-d8b0-4e1c-8786-17ef7aec7373 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:45.701655 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148d6d-d8b0-4e1c-8786-17ef7aec7373 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:45.701922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148d6d-d8b0-4e1c-8786-17ef7aec7373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:45.709778 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6148d6d-d8b0-4e1c-8786-17ef7aec7373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:45.711383 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6148d6d-d8b0-4e1c-8786-17ef7aec7373 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:45.721428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 842/1683] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:45.802242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:46.203760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed51b5-84ca-483f-a7d6-373b42c192e3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:46.267365 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed51b5-84ca-483f-a7d6-373b42c192e3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:46.271923 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:46.272546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:46.272814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:46.273077 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] PATH_INFO: `/v3/users/3d3801003e2048979568dd6be8c9d180` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:46.274291 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3801003e2048979568dd6be8c9d180)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:46.276218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:46.468854 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3801003e2048979568dd6be8c9d180'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:46.469555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3801003e2048979568dd6be8c9d180'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:46.476728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3801003e2048979568dd6be8c9d180'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:46.522366 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3801003e2048979568dd6be8c9d180'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:46.534840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3801003e2048979568dd6be8c9d180'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:46.541301 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 842/1684] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:46 2022] DELETE /identity/v3/users/3d3801003e2048979568dd6be8c9d180 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:46.546469 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebc24b-cdc8-4a48-8e7f-6a2117af134a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:46.546754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebc24b-cdc8-4a48-8e7f-6a2117af134a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:46.547028 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebc24b-cdc8-4a48-8e7f-6a2117af134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:46.566427 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-3cebc24b-cdc8-4a48-8e7f-6a2117af134a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:46.567629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3cebc24b-cdc8-4a48-8e7f-6a2117af134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:46.626570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 843/1685] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:46.636561 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:46.638495 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:46.696680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cac071-09b7-415f-9cba-9946f4c45cb4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:46.700882 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52ea7e-93d9-4baf-9dd8-53e8e6691c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:46.701527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52ea7e-93d9-4baf-9dd8-53e8e6691c83 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:46.701806 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52ea7e-93d9-4baf-9dd8-53e8e6691c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:46.702079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52ea7e-93d9-4baf-9dd8-53e8e6691c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:46.711516 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52ea7e-93d9-4baf-9dd8-53e8e6691c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:46.713114 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52ea7e-93d9-4baf-9dd8-53e8e6691c83 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:46.724084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 843/1686] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:46.968778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:47.042471 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:47.250094 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebc24b-cdc8-4a48-8e7f-6a2117af134a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:47.252591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3cebc24b-cdc8-4a48-8e7f-6a2117af134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:47.267342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebc24b-cdc8-4a48-8e7f-6a2117af134a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:47.271852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5046250-a3a0-40cc-a910-8d3ab56babef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:47.272478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046250-a3a0-40cc-a910-8d3ab56babef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:47.272756 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046250-a3a0-40cc-a910-8d3ab56babef admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:47.273079 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046250-a3a0-40cc-a910-8d3ab56babef admin admin] PATH_INFO: `/v3/projects/8e1688a912164f1fb1e5748f465574a7` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:47.274216 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5046250-a3a0-40cc-a910-8d3ab56babef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1688a912164f1fb1e5748f465574a7)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:47.276097 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5046250-a3a0-40cc-a910-8d3ab56babef admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:47.436550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c5046250-a3a0-40cc-a910-8d3ab56babef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1688a912164f1fb1e5748f465574a7', 'request_id': 'req-c5046250-a3a0-40cc-a910-8d3ab56babef'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:47.528854 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c5046250-a3a0-40cc-a910-8d3ab56babef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1688a912164f1fb1e5748f465574a7', 'request_id': 'req-c5046250-a3a0-40cc-a910-8d3ab56babef'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:47.540301 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c5046250-a3a0-40cc-a910-8d3ab56babef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1688a912164f1fb1e5748f465574a7', 'request_id': 'req-c5046250-a3a0-40cc-a910-8d3ab56babef'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:47.552721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c5046250-a3a0-40cc-a910-8d3ab56babef admin admin] The token cache is being invalidate because project 8e1688a912164f1fb1e5748f465574a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:47.553025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c5046250-a3a0-40cc-a910-8d3ab56babef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:47.553817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c5046250-a3a0-40cc-a910-8d3ab56babef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:47.555508 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 844/1687] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:47 2022] DELETE /identity/v3/projects/8e1688a912164f1fb1e5748f465574a7 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:47.560712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf04f-9d42-417f-91a3-37de9ac186ab None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:47.562017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf04f-9d42-417f-91a3-37de9ac186ab None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:47.562473 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf04f-9d42-417f-91a3-37de9ac186ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:47.582991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4ceaf04f-9d42-417f-91a3-37de9ac186ab None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:47.584213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4ceaf04f-9d42-417f-91a3-37de9ac186ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:47.639961 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:47.668892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 844/1688] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:10:47.668987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa82f5-67a7-4091-97ac-29f186a16562 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:47.668987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa82f5-67a7-4091-97ac-29f186a16562 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:47.668987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa82f5-67a7-4091-97ac-29f186a16562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:47.684611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-81fa82f5-67a7-4091-97ac-29f186a16562 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:47.685836 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-81fa82f5-67a7-4091-97ac-29f186a16562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:47.693760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 845/1689] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:47.697947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaf04f-9d42-417f-91a3-37de9ac186ab None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:47.708370 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaf04f-9d42-417f-91a3-37de9ac186ab None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:47.712991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc16b8-7b3c-4ced-8232-4bb1f1e5c2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:47.713616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc16b8-7b3c-4ced-8232-4bb1f1e5c2dd admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:47.713887 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc16b8-7b3c-4ced-8232-4bb1f1e5c2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:47.714153 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc16b8-7b3c-4ced-8232-4bb1f1e5c2dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:47.714824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc16b8-7b3c-4ced-8232-4bb1f1e5c2dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:10:47.715296 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc16b8-7b3c-4ced-8232-4bb1f1e5c2dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:47.716870 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc16b8-7b3c-4ced-8232-4bb1f1e5c2dd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:47.728375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 845/1690] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:10:47.733312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa82f5-67a7-4091-97ac-29f186a16562 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:47.742847 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa82f5-67a7-4091-97ac-29f186a16562 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:47.748367 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b33282-fbb9-4dcb-8378-7b8d1f40ef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:47.748965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33282-fbb9-4dcb-8378-7b8d1f40ef2c admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:47.749257 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33282-fbb9-4dcb-8378-7b8d1f40ef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:47.749537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33282-fbb9-4dcb-8378-7b8d1f40ef2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:47.750219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b33282-fbb9-4dcb-8378-7b8d1f40ef2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:47.752121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b33282-fbb9-4dcb-8378-7b8d1f40ef2c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:47.774033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:47.913239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 846/1691] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:47 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:10:47.920531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc16b8-7b3c-4ced-8232-4bb1f1e5c2dd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:47.931247 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc16b8-7b3c-4ced-8232-4bb1f1e5c2dd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:47.993639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc123363-7db2-4270-a8e1-136dc2905c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:47.994277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc123363-7db2-4270-a8e1-136dc2905c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:47.994556 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc123363-7db2-4270-a8e1-136dc2905c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:47.994827 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc123363-7db2-4270-a8e1-136dc2905c21 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:47.996058 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc123363-7db2-4270-a8e1-136dc2905c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:47.998218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc123363-7db2-4270-a8e1-136dc2905c21 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:48.145989 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 846/1692] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:47 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:48.150174 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b33282-fbb9-4dcb-8378-7b8d1f40ef2c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:48.161652 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b33282-fbb9-4dcb-8378-7b8d1f40ef2c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:48.166597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a4f26-103e-4f58-aa36-3d500855824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:48.167238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4f26-103e-4f58-aa36-3d500855824d admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:48.167456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4f26-103e-4f58-aa36-3d500855824d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:48.167725 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4f26-103e-4f58-aa36-3d500855824d admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:48.168386 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a4f26-103e-4f58-aa36-3d500855824d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:48.170066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a4f26-103e-4f58-aa36-3d500855824d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:48.184488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 847/1693] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:48.186123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc123363-7db2-4270-a8e1-136dc2905c21 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:48.201599 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc123363-7db2-4270-a8e1-136dc2905c21 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:48.206267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58edb651-c80c-4167-b775-7f63a4a57ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:48.207018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edb651-c80c-4167-b775-7f63a4a57ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:48.207386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edb651-c80c-4167-b775-7f63a4a57ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:48.207655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58edb651-c80c-4167-b775-7f63a4a57ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:48.208305 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edb651-c80c-4167-b775-7f63a4a57ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:48.209923 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58edb651-c80c-4167-b775-7f63a4a57ce8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:48.222178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 847/1694] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:48.226488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a4f26-103e-4f58-aa36-3d500855824d admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:48.237964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a4f26-103e-4f58-aa36-3d500855824d admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:48.242572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb5eaf-c94b-4904-bd04-2f9e5effc0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:48.243320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb5eaf-c94b-4904-bd04-2f9e5effc0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:48.243598 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb5eaf-c94b-4904-bd04-2f9e5effc0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:48.243866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb5eaf-c94b-4904-bd04-2f9e5effc0ce admin admin] PATH_INFO: `/v3/projects/8c30300fe45646b8a889c7fa1ca2c7d2/users/30156075f9c44c10a0b3b09f6d5431f5/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:48.258643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb5eaf-c94b-4904-bd04-2f9e5effc0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c30300fe45646b8a889c7fa1ca2c7d2, user_id=30156075f9c44c10a0b3b09f6d5431f5, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:48.261276 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb5eaf-c94b-4904-bd04-2f9e5effc0ce admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:48.352283 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 848/1695] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:48 2022] PUT /identity/v3/projects/8c30300fe45646b8a889c7fa1ca2c7d2/users/30156075f9c44c10a0b3b09f6d5431f5/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:48.363707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4de9e-9684-4e36-b860-56d7af136c02 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:48.363991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4de9e-9684-4e36-b860-56d7af136c02 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:48.364290 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4de9e-9684-4e36-b860-56d7af136c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:48.392232 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9ea4de9e-9684-4e36-b860-56d7af136c02 None None] MFA Rules not processed for user `30156075f9c44c10a0b3b09f6d5431f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:48.393474 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9ea4de9e-9684-4e36-b860-56d7af136c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:48.460675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 848/1696] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:48.466153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb5eaf-c94b-4904-bd04-2f9e5effc0ce admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:48.529327 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb5eaf-c94b-4904-bd04-2f9e5effc0ce admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:48.534028 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5f98-6f9f-4f89-8975-e8d1c5dfb973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:48.534625 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5f98-6f9f-4f89-8975-e8d1c5dfb973 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:48.534895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5f98-6f9f-4f89-8975-e8d1c5dfb973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:48.535160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5f98-6f9f-4f89-8975-e8d1c5dfb973 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:48.535785 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5f98-6f9f-4f89-8975-e8d1c5dfb973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:48.537928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5f98-6f9f-4f89-8975-e8d1c5dfb973 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:48.650309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 849/1697] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:48 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:48.658829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4de9e-9684-4e36-b860-56d7af136c02 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:48.670155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4de9e-9684-4e36-b860-56d7af136c02 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:48.727573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105466af-2cde-4d99-b943-d03bcee45f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:48.728095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105466af-2cde-4d99-b943-d03bcee45f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:48.728369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105466af-2cde-4d99-b943-d03bcee45f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:48.728666 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105466af-2cde-4d99-b943-d03bcee45f44 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:48.729308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105466af-2cde-4d99-b943-d03bcee45f44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:48.731789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105466af-2cde-4d99-b943-d03bcee45f44 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:48.865897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 849/1698] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:48 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:48.865996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5f98-6f9f-4f89-8975-e8d1c5dfb973 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:48.871748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5f98-6f9f-4f89-8975-e8d1c5dfb973 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:48.876477 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f00f5-4652-40a2-a2c6-77f4eb1155ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:48.877223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f00f5-4652-40a2-a2c6-77f4eb1155ef admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:48.877542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f00f5-4652-40a2-a2c6-77f4eb1155ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:48.877806 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f00f5-4652-40a2-a2c6-77f4eb1155ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:48.878442 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f00f5-4652-40a2-a2c6-77f4eb1155ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:48.880370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f00f5-4652-40a2-a2c6-77f4eb1155ef admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:48.895068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 850/1699] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:48.906178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105466af-2cde-4d99-b943-d03bcee45f44 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:48.916763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105466af-2cde-4d99-b943-d03bcee45f44 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:48.922241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47627c-9faa-478d-92d2-12c0af5b449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:48.922890 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47627c-9faa-478d-92d2-12c0af5b449a admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:48.923195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47627c-9faa-478d-92d2-12c0af5b449a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:48.926906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47627c-9faa-478d-92d2-12c0af5b449a admin admin] PATH_INFO: `/v3/projects/3b7811576192486197fedffb1c4e07ef/users/32a901a6d27c45f3bbbc7b8934ba41ac/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:48.938916 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47627c-9faa-478d-92d2-12c0af5b449a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7811576192486197fedffb1c4e07ef, user_id=32a901a6d27c45f3bbbc7b8934ba41ac, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:48.942149 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47627c-9faa-478d-92d2-12c0af5b449a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:48.945357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:49.020808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 850/1700] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:48 2022] PUT /identity/v3/projects/3b7811576192486197fedffb1c4e07ef/users/32a901a6d27c45f3bbbc7b8934ba41ac/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:49.024600 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f00f5-4652-40a2-a2c6-77f4eb1155ef admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:49.036649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f00f5-4652-40a2-a2c6-77f4eb1155ef admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:49.108892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a7fa5-bdc5-43f1-bfc9-d784f78d8026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:49.110975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7fa5-bdc5-43f1-bfc9-d784f78d8026 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:49.111197 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7fa5-bdc5-43f1-bfc9-d784f78d8026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:49.112096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a7fa5-bdc5-43f1-bfc9-d784f78d8026 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:49.112752 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a7fa5-bdc5-43f1-bfc9-d784f78d8026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:49.115153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a7fa5-bdc5-43f1-bfc9-d784f78d8026 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:49.128832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 851/1701] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:49.136117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47627c-9faa-478d-92d2-12c0af5b449a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:49.147894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47627c-9faa-478d-92d2-12c0af5b449a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:49.154153 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d2918-e0d3-4c90-959a-17d10579173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:49.154912 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d2918-e0d3-4c90-959a-17d10579173a admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:49.160026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d2918-e0d3-4c90-959a-17d10579173a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:49.160026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d2918-e0d3-4c90-959a-17d10579173a admin admin] PATH_INFO: `/v3/projects/3b7811576192486197fedffb1c4e07ef/users/32a901a6d27c45f3bbbc7b8934ba41ac/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:49.160026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d2918-e0d3-4c90-959a-17d10579173a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7811576192486197fedffb1c4e07ef, user_id=32a901a6d27c45f3bbbc7b8934ba41ac, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:49.160926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d2918-e0d3-4c90-959a-17d10579173a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:49.173118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 851/1702] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:49 2022] PUT /identity/v3/projects/3b7811576192486197fedffb1c4e07ef/users/32a901a6d27c45f3bbbc7b8934ba41ac/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:49.185702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa4140-ecfc-46ed-a07f-4b7e2a52fc7b None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:49.186014 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa4140-ecfc-46ed-a07f-4b7e2a52fc7b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:49.188595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa4140-ecfc-46ed-a07f-4b7e2a52fc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:49.219257 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-12aa4140-ecfc-46ed-a07f-4b7e2a52fc7b None None] MFA Rules not processed for user `32a901a6d27c45f3bbbc7b8934ba41ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:49.221183 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-12aa4140-ecfc-46ed-a07f-4b7e2a52fc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:49.295693 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 852/1703] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:49.308090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d2918-e0d3-4c90-959a-17d10579173a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:49.310054 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e96d2918-e0d3-4c90-959a-17d10579173a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:49.367769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d2918-e0d3-4c90-959a-17d10579173a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:49.371419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600a059-d387-4820-aad1-f1c5d2d56806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:49.372103 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600a059-d387-4820-aad1-f1c5d2d56806 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:49.372380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600a059-d387-4820-aad1-f1c5d2d56806 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:49.372649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600a059-d387-4820-aad1-f1c5d2d56806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:49.381890 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600a059-d387-4820-aad1-f1c5d2d56806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:49.383408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600a059-d387-4820-aad1-f1c5d2d56806 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:49.393391 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 852/1704] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:49.642211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:49.741578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa4140-ecfc-46ed-a07f-4b7e2a52fc7b None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:49.752211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa4140-ecfc-46ed-a07f-4b7e2a52fc7b None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:49.755812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447ff8b-b16d-42dc-b2dd-1e5f1794f417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:49.756411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447ff8b-b16d-42dc-b2dd-1e5f1794f417 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:49.756687 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447ff8b-b16d-42dc-b2dd-1e5f1794f417 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:49.757046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447ff8b-b16d-42dc-b2dd-1e5f1794f417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:49.814697 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447ff8b-b16d-42dc-b2dd-1e5f1794f417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:49.816193 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447ff8b-b16d-42dc-b2dd-1e5f1794f417 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:49.825623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 853/1705] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:49.877241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:50.080545 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600a059-d387-4820-aad1-f1c5d2d56806 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:50.082075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e600a059-d387-4820-aad1-f1c5d2d56806 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:50.147121 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600a059-d387-4820-aad1-f1c5d2d56806 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:50.151647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:50.152358 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:50.152829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:50.153268 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] PATH_INFO: `/v3/users/f1723048a89544ad8d9c09de0f00d895` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:50.154768 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1723048a89544ad8d9c09de0f00d895)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:50.156903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:50.256768 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:50.301792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:50.343163 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1723048a89544ad8d9c09de0f00d895'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:50.344536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1723048a89544ad8d9c09de0f00d895'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:50.352541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1723048a89544ad8d9c09de0f00d895'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:50.454766 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1723048a89544ad8d9c09de0f00d895'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:50.468974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1723048a89544ad8d9c09de0f00d895'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:50.475694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 853/1706] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:50 2022] DELETE /identity/v3/users/f1723048a89544ad8d9c09de0f00d895 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:50.481085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54500450-5b13-43f3-9ee3-206120d3e47a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:50.481397 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54500450-5b13-43f3-9ee3-206120d3e47a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:50.481739 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54500450-5b13-43f3-9ee3-206120d3e47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:50.501749 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-54500450-5b13-43f3-9ee3-206120d3e47a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:50.502982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-54500450-5b13-43f3-9ee3-206120d3e47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:50.565525 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 854/1707] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:50.576195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:50.577647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:50.637167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4683211-69c1-4858-9c61-af8e83d57af0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:50.642172 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604ec4f-2f9b-499e-b1e8-fb764400c838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:50.647280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604ec4f-2f9b-499e-b1e8-fb764400c838 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:50.647280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604ec4f-2f9b-499e-b1e8-fb764400c838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:50.647280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604ec4f-2f9b-499e-b1e8-fb764400c838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:50.653543 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604ec4f-2f9b-499e-b1e8-fb764400c838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:50.655029 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604ec4f-2f9b-499e-b1e8-fb764400c838 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:50.664779 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 854/1708] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:51.123703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:51.132851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54500450-5b13-43f3-9ee3-206120d3e47a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:51.132851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-54500450-5b13-43f3-9ee3-206120d3e47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:51.145990 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54500450-5b13-43f3-9ee3-206120d3e47a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:51.150820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:51.155578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:51.155578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:51.155578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] PATH_INFO: `/v3/projects/af9a0de8d09d4a758f999bc3cae4527f` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:51.155578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9a0de8d09d4a758f999bc3cae4527f)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:51.155852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:51.288293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9a0de8d09d4a758f999bc3cae4527f', 'request_id': 'req-d2b669d1-0090-4333-8404-7538caa10964'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:51.431529 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9a0de8d09d4a758f999bc3cae4527f', 'request_id': 'req-d2b669d1-0090-4333-8404-7538caa10964'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:51.434989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:51.441348 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9a0de8d09d4a758f999bc3cae4527f', 'request_id': 'req-d2b669d1-0090-4333-8404-7538caa10964'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:51.453117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] The token cache is being invalidate because project af9a0de8d09d4a758f999bc3cae4527f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:51.453444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:51.454133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:51.455615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 855/1709] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:51 2022] DELETE /identity/v3/projects/af9a0de8d09d4a758f999bc3cae4527f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:51.459886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604ec4f-2f9b-499e-b1e8-fb764400c838 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:51.469710 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604ec4f-2f9b-499e-b1e8-fb764400c838 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:51.528651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:51.529325 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:51.529608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:51.529880 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] PATH_INFO: `/v3/users/1d281ca411704ab08b8c788d65016416` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:51.530985 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d281ca411704ab08b8c788d65016416)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:51.532984 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:51.751962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d281ca411704ab08b8c788d65016416'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:51.752655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d281ca411704ab08b8c788d65016416'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:51.759703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d281ca411704ab08b8c788d65016416'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:51.842295 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d281ca411704ab08b8c788d65016416'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:51.855070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d281ca411704ab08b8c788d65016416'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:51.861718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 855/1710] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:51 2022] DELETE /identity/v3/users/1d281ca411704ab08b8c788d65016416 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:52.025216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:52.519621 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:52.521082 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:52.553728 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b669d1-0090-4333-8404-7538caa10964 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:52.559831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:52.614843 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:52.615476 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:52.615746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:52.616016 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] PATH_INFO: `/v3/projects/8ee767a04b284a0a91e6cb587cbb06da` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:52.617384 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee767a04b284a0a91e6cb587cbb06da)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:52.623059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:52.774155 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee767a04b284a0a91e6cb587cbb06da', 'request_id': 'req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:52.853960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee767a04b284a0a91e6cb587cbb06da', 'request_id': 'req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:52.864357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee767a04b284a0a91e6cb587cbb06da', 'request_id': 'req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:52.882049 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] The token cache is being invalidate because project 8ee767a04b284a0a91e6cb587cbb06da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:52.882408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:52.883487 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:52.885455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 856/1711] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:52 2022] DELETE /identity/v3/projects/8ee767a04b284a0a91e6cb587cbb06da => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:52.889804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:52.891587 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:52.904961 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7c0f2-e47b-423c-acb6-67ce80f2c9aa admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:52.980060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e1c9c-d10b-4da5-afae-7918b7ab80cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:52.981010 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e1c9c-d10b-4da5-afae-7918b7ab80cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:52.981318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e1c9c-d10b-4da5-afae-7918b7ab80cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:52.981591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e1c9c-d10b-4da5-afae-7918b7ab80cd admin admin] PATH_INFO: `/v3/users/760c095c9a1244eba689c05a81f34470` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:52.982746 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e1c9c-d10b-4da5-afae-7918b7ab80cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=760c095c9a1244eba689c05a81f34470)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:52.984649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e1c9c-d10b-4da5-afae-7918b7ab80cd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:53.247037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-546e1c9c-d10b-4da5-afae-7918b7ab80cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760c095c9a1244eba689c05a81f34470'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:53.247841 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-546e1c9c-d10b-4da5-afae-7918b7ab80cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760c095c9a1244eba689c05a81f34470'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:53.255741 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-546e1c9c-d10b-4da5-afae-7918b7ab80cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760c095c9a1244eba689c05a81f34470'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:53.396634 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-546e1c9c-d10b-4da5-afae-7918b7ab80cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760c095c9a1244eba689c05a81f34470'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:53.409511 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-546e1c9c-d10b-4da5-afae-7918b7ab80cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760c095c9a1244eba689c05a81f34470'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:53.415582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 856/1712] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:52 2022] DELETE /identity/v3/users/760c095c9a1244eba689c05a81f34470 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:53.940169 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:53.941979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:53.955936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e991b-9ecf-47a9-8129-9f2a58e8a6e6 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:54.016917 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66ceed-4755-44f9-bf37-f43baf9e0748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:54.017596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66ceed-4755-44f9-bf37-f43baf9e0748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:54.018042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66ceed-4755-44f9-bf37-f43baf9e0748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:54.018164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66ceed-4755-44f9-bf37-f43baf9e0748 admin admin] PATH_INFO: `/v3/projects/577c5b0520874b17bea2b3596e5c039b` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:54.019507 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66ceed-4755-44f9-bf37-f43baf9e0748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=577c5b0520874b17bea2b3596e5c039b)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:54.021609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66ceed-4755-44f9-bf37-f43baf9e0748 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:54.128746 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:54.151969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cb66ceed-4755-44f9-bf37-f43baf9e0748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577c5b0520874b17bea2b3596e5c039b', 'request_id': 'req-cb66ceed-4755-44f9-bf37-f43baf9e0748'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:54.231590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cb66ceed-4755-44f9-bf37-f43baf9e0748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577c5b0520874b17bea2b3596e5c039b', 'request_id': 'req-cb66ceed-4755-44f9-bf37-f43baf9e0748'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:54.238763 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cb66ceed-4755-44f9-bf37-f43baf9e0748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577c5b0520874b17bea2b3596e5c039b', 'request_id': 'req-cb66ceed-4755-44f9-bf37-f43baf9e0748'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:54.250045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cb66ceed-4755-44f9-bf37-f43baf9e0748 admin admin] The token cache is being invalidate because project 577c5b0520874b17bea2b3596e5c039b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:54.250327 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cb66ceed-4755-44f9-bf37-f43baf9e0748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:54.250949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cb66ceed-4755-44f9-bf37-f43baf9e0748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:54.252439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 857/1713] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:53 2022] DELETE /identity/v3/projects/577c5b0520874b17bea2b3596e5c039b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:54.258517 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77f03e-9b21-46c7-868f-036399797ebe None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:54.258793 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77f03e-9b21-46c7-868f-036399797ebe None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:54.259136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77f03e-9b21-46c7-868f-036399797ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:54.278885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9d77f03e-9b21-46c7-868f-036399797ebe None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:54.280071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9d77f03e-9b21-46c7-868f-036399797ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:54.341995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 857/1714] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:54.355663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560abd-16d5-40e7-b35b-fc68ed12c9f8 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:54.356127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560abd-16d5-40e7-b35b-fc68ed12c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:54.356450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560abd-16d5-40e7-b35b-fc68ed12c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:54.377626 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-5c560abd-16d5-40e7-b35b-fc68ed12c9f8 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:54.378826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5c560abd-16d5-40e7-b35b-fc68ed12c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:54.387400 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 858/1715] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:54.391687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77f03e-9b21-46c7-868f-036399797ebe None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:54.401071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77f03e-9b21-46c7-868f-036399797ebe None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:54.406933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1249fd-ca51-4a43-a3e0-e709583942d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:54.407471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1249fd-ca51-4a43-a3e0-e709583942d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:54.407752 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1249fd-ca51-4a43-a3e0-e709583942d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:54.408172 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1249fd-ca51-4a43-a3e0-e709583942d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:54.408826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1249fd-ca51-4a43-a3e0-e709583942d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:10:54.409122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1249fd-ca51-4a43-a3e0-e709583942d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:54.410797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1249fd-ca51-4a43-a3e0-e709583942d6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:54.423543 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 858/1716] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:10:54.428207 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c560abd-16d5-40e7-b35b-fc68ed12c9f8 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:54.438114 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c560abd-16d5-40e7-b35b-fc68ed12c9f8 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:54.442915 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dacf90-3975-403a-a3d3-f47528efb977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:54.448030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dacf90-3975-403a-a3d3-f47528efb977 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:54.448030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dacf90-3975-403a-a3d3-f47528efb977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:54.448030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dacf90-3975-403a-a3d3-f47528efb977 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:54.448030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dacf90-3975-403a-a3d3-f47528efb977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:54.448030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dacf90-3975-403a-a3d3-f47528efb977 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:54.535471 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 859/1717] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:10:54 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:54.539622 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1249fd-ca51-4a43-a3e0-e709583942d6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:54.545824 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:54.550461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1249fd-ca51-4a43-a3e0-e709583942d6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:54.607079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0deda-5628-4049-85bf-8ed9112ad8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:54.607765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0deda-5628-4049-85bf-8ed9112ad8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:54.608053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0deda-5628-4049-85bf-8ed9112ad8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:54.608322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0deda-5628-4049-85bf-8ed9112ad8d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:54.608997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0deda-5628-4049-85bf-8ed9112ad8d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:54.611035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0deda-5628-4049-85bf-8ed9112ad8d1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:54.700222 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 859/1718] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:10:54 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:10:54.704361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dacf90-3975-403a-a3d3-f47528efb977 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:54.715008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dacf90-3975-403a-a3d3-f47528efb977 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:54.719613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff717df-8e8e-4c9d-a8b4-0323b412230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:54.720236 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff717df-8e8e-4c9d-a8b4-0323b412230e admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:54.720506 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff717df-8e8e-4c9d-a8b4-0323b412230e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:54.720771 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff717df-8e8e-4c9d-a8b4-0323b412230e admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:54.721428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff717df-8e8e-4c9d-a8b4-0323b412230e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:54.722997 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff717df-8e8e-4c9d-a8b4-0323b412230e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:54.734035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 860/1719] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:10:54.742118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0deda-5628-4049-85bf-8ed9112ad8d1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:54.752828 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0deda-5628-4049-85bf-8ed9112ad8d1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:54.757496 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900e73d-ca6f-46de-b116-071e2526a536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:54.758090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900e73d-ca6f-46de-b116-071e2526a536 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:54.758385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900e73d-ca6f-46de-b116-071e2526a536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:54.758643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900e73d-ca6f-46de-b116-071e2526a536 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:54.759277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900e73d-ca6f-46de-b116-071e2526a536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:54.760902 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900e73d-ca6f-46de-b116-071e2526a536 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:54.771297 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 860/1720] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:10:54.775309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff717df-8e8e-4c9d-a8b4-0323b412230e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:54.785069 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff717df-8e8e-4c9d-a8b4-0323b412230e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:54.789711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c66fe-6232-403b-94ca-2e034915a4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:54.790369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c66fe-6232-403b-94ca-2e034915a4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:54.790684 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c66fe-6232-403b-94ca-2e034915a4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:54.790899 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c66fe-6232-403b-94ca-2e034915a4e4 admin admin] PATH_INFO: `/v3/projects/c0fe3cd493b44b8abe006feaa20084dc/users/fc8b820854514a08a012a97b14324365/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:54.812128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c66fe-6232-403b-94ca-2e034915a4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fe3cd493b44b8abe006feaa20084dc, user_id=fc8b820854514a08a012a97b14324365, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:54.814786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c66fe-6232-403b-94ca-2e034915a4e4 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:54.911611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 861/1721] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:10:54 2022] PUT /identity/v3/projects/c0fe3cd493b44b8abe006feaa20084dc/users/fc8b820854514a08a012a97b14324365/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:54.927280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187fdd8-ade2-4119-9eaa-78c935940b7c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:54.927603 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187fdd8-ade2-4119-9eaa-78c935940b7c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:54.927874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187fdd8-ade2-4119-9eaa-78c935940b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:54.956930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1187fdd8-ade2-4119-9eaa-78c935940b7c None None] MFA Rules not processed for user `fc8b820854514a08a012a97b14324365`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:54.958697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1187fdd8-ade2-4119-9eaa-78c935940b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:55.024101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 861/1722] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:10:55.036825 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c66fe-6232-403b-94ca-2e034915a4e4 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:55.040110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-df2c66fe-6232-403b-94ca-2e034915a4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:55.099755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c66fe-6232-403b-94ca-2e034915a4e4 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:55.103534 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d96c12-da2d-4fc0-af9a-24f68141070f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74317ae6b47843de85d03f3a9d3a811d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:55.104158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96c12-da2d-4fc0-af9a-24f68141070f service glance] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:55.104431 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96c12-da2d-4fc0-af9a-24f68141070f service glance] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:55.104714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96c12-da2d-4fc0-af9a-24f68141070f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:55.116172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d96c12-da2d-4fc0-af9a-24f68141070f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:55.116893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:55.117641 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d96c12-da2d-4fc0-af9a-24f68141070f service glance] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:55.130925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 862/1723] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:58.553133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187fdd8-ade2-4119-9eaa-78c935940b7c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:58.554622 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1187fdd8-ade2-4119-9eaa-78c935940b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:58.611959 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:58.633267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187fdd8-ade2-4119-9eaa-78c935940b7c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:58.638016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:58.638734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:58.639428 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:58.639700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] PATH_INFO: `/v3/users/8b2a79f22cec449bbc35004184540b93` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:58.640838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2a79f22cec449bbc35004184540b93)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:58.642787 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:58.932493 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2a79f22cec449bbc35004184540b93'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:58.933302 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2a79f22cec449bbc35004184540b93'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:58.945090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2a79f22cec449bbc35004184540b93'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:58.997362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2a79f22cec449bbc35004184540b93'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:59.017181 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2a79f22cec449bbc35004184540b93'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:59.024365 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 862/1724] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:10:58 2022] DELETE /identity/v3/users/8b2a79f22cec449bbc35004184540b93 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:10:59.033337 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4487b1-1736-4ba3-b259-26ce55274c8f None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:59.033807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4487b1-1736-4ba3-b259-26ce55274c8f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:59.033915 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4487b1-1736-4ba3-b259-26ce55274c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:59.053597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-5b4487b1-1736-4ba3-b259-26ce55274c8f None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:59.055046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5b4487b1-1736-4ba3-b259-26ce55274c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:59.117885 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 863/1725] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:10:59.127840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:59.129315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:59.189108 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95acac-2e7a-4558-8c60-fd36e843be02 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:59.193002 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d731b-5001-4219-afd7-4c43fe7e39f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:59.193641 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d731b-5001-4219-afd7-4c43fe7e39f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:59.193915 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d731b-5001-4219-afd7-4c43fe7e39f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:59.194183 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d731b-5001-4219-afd7-4c43fe7e39f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:59.203571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d731b-5001-4219-afd7-4c43fe7e39f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:59.204979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d731b-5001-4219-afd7-4c43fe7e39f2 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:59.214334 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 863/1726] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:10:59.621689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4487b1-1736-4ba3-b259-26ce55274c8f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:10:59.623820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5b4487b1-1736-4ba3-b259-26ce55274c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:59.635952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4487b1-1736-4ba3-b259-26ce55274c8f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:10:59.641209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977d5de-bfab-4ba8-a18d-67a03361eb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:10:59.641941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977d5de-bfab-4ba8-a18d-67a03361eb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:59.642222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977d5de-bfab-4ba8-a18d-67a03361eb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:59.642482 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977d5de-bfab-4ba8-a18d-67a03361eb83 admin admin] PATH_INFO: `/v3/projects/9a142f79891949219b15ac68e9d6f762` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:59.644033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977d5de-bfab-4ba8-a18d-67a03361eb83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a142f79891949219b15ac68e9d6f762)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:10:59.646011 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977d5de-bfab-4ba8-a18d-67a03361eb83 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:10:59.648658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:10:59.753472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e977d5de-bfab-4ba8-a18d-67a03361eb83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a142f79891949219b15ac68e9d6f762', 'request_id': 'req-e977d5de-bfab-4ba8-a18d-67a03361eb83'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:59.838412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e977d5de-bfab-4ba8-a18d-67a03361eb83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a142f79891949219b15ac68e9d6f762', 'request_id': 'req-e977d5de-bfab-4ba8-a18d-67a03361eb83'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:59.846463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e977d5de-bfab-4ba8-a18d-67a03361eb83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a142f79891949219b15ac68e9d6f762', 'request_id': 'req-e977d5de-bfab-4ba8-a18d-67a03361eb83'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:59.858847 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e977d5de-bfab-4ba8-a18d-67a03361eb83 admin admin] The token cache is being invalidate because project 9a142f79891949219b15ac68e9d6f762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:10:59.859131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e977d5de-bfab-4ba8-a18d-67a03361eb83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:59.859797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e977d5de-bfab-4ba8-a18d-67a03361eb83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:10:59.861370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 864/1727] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:10:59 2022] DELETE /identity/v3/projects/9a142f79891949219b15ac68e9d6f762 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:10:59.867423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d25eb5-b834-4ff8-a453-88e3b36788ab None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:59.867896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d25eb5-b834-4ff8-a453-88e3b36788ab None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:59.867989 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d25eb5-b834-4ff8-a453-88e3b36788ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:10:59.898868 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-92d25eb5-b834-4ff8-a453-88e3b36788ab None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:10:59.900315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-92d25eb5-b834-4ff8-a453-88e3b36788ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:10:59.964283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 864/1728] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:10:59.972315 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20226e4-77c3-48e7-b3ef-faffd7c56d81 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:10:59.972622 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20226e4-77c3-48e7-b3ef-faffd7c56d81 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:10:59.973506 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20226e4-77c3-48e7-b3ef-faffd7c56d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:00.002125 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d20226e4-77c3-48e7-b3ef-faffd7c56d81 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:00.003408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d20226e4-77c3-48e7-b3ef-faffd7c56d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:00.014431 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 865/1729] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:00.019072 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d25eb5-b834-4ff8-a453-88e3b36788ab None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:00.030272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d25eb5-b834-4ff8-a453-88e3b36788ab None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:00.034505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908c4ff-d0a2-4612-bd80-7a9df72d9f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:00.035306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c4ff-d0a2-4612-bd80-7a9df72d9f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:00.035588 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c4ff-d0a2-4612-bd80-7a9df72d9f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:00.035887 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c4ff-d0a2-4612-bd80-7a9df72d9f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:00.036573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908c4ff-d0a2-4612-bd80-7a9df72d9f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:11:00.037022 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908c4ff-d0a2-4612-bd80-7a9df72d9f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:00.038850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908c4ff-d0a2-4612-bd80-7a9df72d9f07 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:00.040626 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:00.054314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 865/1730] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:11:00.058237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20226e4-77c3-48e7-b3ef-faffd7c56d81 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:00.068364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20226e4-77c3-48e7-b3ef-faffd7c56d81 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:00.073327 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414f040-8ccc-4c48-85de-bc1b13f4b9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:00.074047 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414f040-8ccc-4c48-85de-bc1b13f4b9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:00.074289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414f040-8ccc-4c48-85de-bc1b13f4b9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:00.074553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414f040-8ccc-4c48-85de-bc1b13f4b9f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:00.075187 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414f040-8ccc-4c48-85de-bc1b13f4b9f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:00.077207 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414f040-8ccc-4c48-85de-bc1b13f4b9f5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:00.209473 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 866/1731] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:11:00 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:11:00.214069 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908c4ff-d0a2-4612-bd80-7a9df72d9f07 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:00.225232 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908c4ff-d0a2-4612-bd80-7a9df72d9f07 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:00.281713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bf416-451e-4cb2-8fba-bb6613355f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:00.282344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bf416-451e-4cb2-8fba-bb6613355f33 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:00.282621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bf416-451e-4cb2-8fba-bb6613355f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:00.282892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bf416-451e-4cb2-8fba-bb6613355f33 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:00.283531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bf416-451e-4cb2-8fba-bb6613355f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:00.286003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440bf416-451e-4cb2-8fba-bb6613355f33 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:00.375897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 866/1732] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:11:00 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:00.380011 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414f040-8ccc-4c48-85de-bc1b13f4b9f5 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:00.391852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414f040-8ccc-4c48-85de-bc1b13f4b9f5 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:00.397543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc121bc-6ba3-4ebe-8063-d3f7f196ac68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:00.399035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc121bc-6ba3-4ebe-8063-d3f7f196ac68 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:00.399035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc121bc-6ba3-4ebe-8063-d3f7f196ac68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:00.399035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc121bc-6ba3-4ebe-8063-d3f7f196ac68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:00.399621 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc121bc-6ba3-4ebe-8063-d3f7f196ac68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:00.401458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc121bc-6ba3-4ebe-8063-d3f7f196ac68 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:00.415190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 867/1733] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:00.419255 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bf416-451e-4cb2-8fba-bb6613355f33 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:00.431558 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bf416-451e-4cb2-8fba-bb6613355f33 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:00.438478 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d3134-3643-4b45-ac9a-b6536e4e3f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:00.444424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d3134-3643-4b45-ac9a-b6536e4e3f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:00.444424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d3134-3643-4b45-ac9a-b6536e4e3f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:00.444424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d3134-3643-4b45-ac9a-b6536e4e3f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:00.444424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d3134-3643-4b45-ac9a-b6536e4e3f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:00.444424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d3134-3643-4b45-ac9a-b6536e4e3f69 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:00.453600 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 867/1734] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:00.457956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc121bc-6ba3-4ebe-8063-d3f7f196ac68 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:00.470288 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc121bc-6ba3-4ebe-8063-d3f7f196ac68 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:00.475037 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09654af0-80a6-4f2e-ac1a-32eef47b85f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:00.476075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09654af0-80a6-4f2e-ac1a-32eef47b85f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:00.476405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09654af0-80a6-4f2e-ac1a-32eef47b85f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:00.476672 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09654af0-80a6-4f2e-ac1a-32eef47b85f4 admin admin] PATH_INFO: `/v3/projects/e40d1aa3d8094546b092968f6e2b6a19/users/fc85e65bf89042f6b79dd93f3ee47443/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:00.500666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09654af0-80a6-4f2e-ac1a-32eef47b85f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40d1aa3d8094546b092968f6e2b6a19, user_id=fc85e65bf89042f6b79dd93f3ee47443, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:00.503863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09654af0-80a6-4f2e-ac1a-32eef47b85f4 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:00.597369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 868/1735] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:00 2022] PUT /identity/v3/projects/e40d1aa3d8094546b092968f6e2b6a19/users/fc85e65bf89042f6b79dd93f3ee47443/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:00.602527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc959480-da29-4267-a756-eb138bc024c5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:00.602831 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc959480-da29-4267-a756-eb138bc024c5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:00.603102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc959480-da29-4267-a756-eb138bc024c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:00.621708 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-bc959480-da29-4267-a756-eb138bc024c5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:00.622892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bc959480-da29-4267-a756-eb138bc024c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:00.680877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 868/1736] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:11:00.690482 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09654af0-80a6-4f2e-ac1a-32eef47b85f4 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:00.692172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-09654af0-80a6-4f2e-ac1a-32eef47b85f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:00.755536 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09654af0-80a6-4f2e-ac1a-32eef47b85f4 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:00.759617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9b687-da33-4f0a-8334-f90c3c6aa570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:00.760308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9b687-da33-4f0a-8334-f90c3c6aa570 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:00.760585 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9b687-da33-4f0a-8334-f90c3c6aa570 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:00.760855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9b687-da33-4f0a-8334-f90c3c6aa570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:00.771242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9b687-da33-4f0a-8334-f90c3c6aa570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:00.773004 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9b687-da33-4f0a-8334-f90c3c6aa570 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:00.783623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 869/1737] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:03.722842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc959480-da29-4267-a756-eb138bc024c5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:03.724735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bc959480-da29-4267-a756-eb138bc024c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:03.738169 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc959480-da29-4267-a756-eb138bc024c5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:03.742897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:03.743638 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:03.743980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:03.744335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] PATH_INFO: `/v3/users/6de3a3a065344510b90efbdcd2368191` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:03.745644 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de3a3a065344510b90efbdcd2368191)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:03.747619 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:03.989413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de3a3a065344510b90efbdcd2368191'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:03.990064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de3a3a065344510b90efbdcd2368191'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:03.998716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de3a3a065344510b90efbdcd2368191'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:04.150177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de3a3a065344510b90efbdcd2368191'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:04.157055 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:04.184306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de3a3a065344510b90efbdcd2368191'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:04.195124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 869/1738] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:11:03 2022] DELETE /identity/v3/users/6de3a3a065344510b90efbdcd2368191 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:04.197531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395b3d7-5e1f-437d-8e32-d0da0bd678ad None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:04.207361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395b3d7-5e1f-437d-8e32-d0da0bd678ad None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:04.207361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395b3d7-5e1f-437d-8e32-d0da0bd678ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:04.283583 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-c395b3d7-5e1f-437d-8e32-d0da0bd678ad None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:04.286730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c395b3d7-5e1f-437d-8e32-d0da0bd678ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:04.367420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:04.426004 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 870/1739] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:04.433608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:04.435547 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:04.538973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471daab4-40ac-4f9e-9fd9-9739d32d2b1f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:04.542694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11defc4-9091-4a9d-891e-acc19231e0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:04.543330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11defc4-9091-4a9d-891e-acc19231e0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:04.543607 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11defc4-9091-4a9d-891e-acc19231e0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:04.543877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11defc4-9091-4a9d-891e-acc19231e0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:04.553514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11defc4-9091-4a9d-891e-acc19231e0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:04.554977 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11defc4-9091-4a9d-891e-acc19231e0f9 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:04.565999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 870/1740] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:11:05.503114 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395b3d7-5e1f-437d-8e32-d0da0bd678ad None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:05.505226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c395b3d7-5e1f-437d-8e32-d0da0bd678ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:05.519701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395b3d7-5e1f-437d-8e32-d0da0bd678ad None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:05.525888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2b268-5225-453d-91d3-2a41369e0a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:05.526820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2b268-5225-453d-91d3-2a41369e0a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:05.531257 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2b268-5225-453d-91d3-2a41369e0a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:05.531257 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2b268-5225-453d-91d3-2a41369e0a8c admin admin] PATH_INFO: `/v3/projects/6fadc645affe416fae4b650c5ff5f26c` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:05.531257 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2b268-5225-453d-91d3-2a41369e0a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fadc645affe416fae4b650c5ff5f26c)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:05.533749 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2b268-5225-453d-91d3-2a41369e0a8c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:05.644538 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-47d2b268-5225-453d-91d3-2a41369e0a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fadc645affe416fae4b650c5ff5f26c', 'request_id': 'req-47d2b268-5225-453d-91d3-2a41369e0a8c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:05.733676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-47d2b268-5225-453d-91d3-2a41369e0a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fadc645affe416fae4b650c5ff5f26c', 'request_id': 'req-47d2b268-5225-453d-91d3-2a41369e0a8c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:05.741430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-47d2b268-5225-453d-91d3-2a41369e0a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fadc645affe416fae4b650c5ff5f26c', 'request_id': 'req-47d2b268-5225-453d-91d3-2a41369e0a8c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:05.756581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-47d2b268-5225-453d-91d3-2a41369e0a8c admin admin] The token cache is being invalidate because project 6fadc645affe416fae4b650c5ff5f26c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:11:05.756879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-47d2b268-5225-453d-91d3-2a41369e0a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:05.757783 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-47d2b268-5225-453d-91d3-2a41369e0a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:05.760995 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 871/1741] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:11:05 2022] DELETE /identity/v3/projects/6fadc645affe416fae4b650c5ff5f26c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:05.766252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb95eb-4c40-4300-a4bd-5f44b22ec871 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:05.771430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb95eb-4c40-4300-a4bd-5f44b22ec871 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:05.771430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb95eb-4c40-4300-a4bd-5f44b22ec871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:05.788345 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f8cb95eb-4c40-4300-a4bd-5f44b22ec871 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:05.789591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f8cb95eb-4c40-4300-a4bd-5f44b22ec871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:05.856874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 871/1742] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:05.866094 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67f694-d339-4371-96b9-6b6d12b3af7d None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:05.866480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67f694-d339-4371-96b9-6b6d12b3af7d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:05.866906 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67f694-d339-4371-96b9-6b6d12b3af7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:05.887056 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0d67f694-d339-4371-96b9-6b6d12b3af7d None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:05.889098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0d67f694-d339-4371-96b9-6b6d12b3af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:05.906832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 872/1743] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:05.911615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb95eb-4c40-4300-a4bd-5f44b22ec871 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:05.932364 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb95eb-4c40-4300-a4bd-5f44b22ec871 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:05.939253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cfa7e-5858-4a92-9ab0-71878822f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:05.939999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cfa7e-5858-4a92-9ab0-71878822f376 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:05.940335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cfa7e-5858-4a92-9ab0-71878822f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:05.940802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cfa7e-5858-4a92-9ab0-71878822f376 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:05.941697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89cfa7e-5858-4a92-9ab0-71878822f376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:11:05.942081 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89cfa7e-5858-4a92-9ab0-71878822f376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:05.945211 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89cfa7e-5858-4a92-9ab0-71878822f376 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:05.965840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 872/1744] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:11:05.971360 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67f694-d339-4371-96b9-6b6d12b3af7d None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:05.981517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67f694-d339-4371-96b9-6b6d12b3af7d None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:05.987911 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2ecca-5f33-4a7e-901b-3fc3972925c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:05.988532 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2ecca-5f33-4a7e-901b-3fc3972925c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:05.988803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2ecca-5f33-4a7e-901b-3fc3972925c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:05.989067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2ecca-5f33-4a7e-901b-3fc3972925c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:05.989738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2ecca-5f33-4a7e-901b-3fc3972925c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:05.991765 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2ecca-5f33-4a7e-901b-3fc3972925c9 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:06.110440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 873/1745] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:11:05 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:06.114227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cfa7e-5858-4a92-9ab0-71878822f376 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:06.126137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cfa7e-5858-4a92-9ab0-71878822f376 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:06.224807 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72aa37e-9113-464c-982a-3be219596e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:06.225717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aa37e-9113-464c-982a-3be219596e0a admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:06.226028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aa37e-9113-464c-982a-3be219596e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:06.226303 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aa37e-9113-464c-982a-3be219596e0a admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:06.227615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72aa37e-9113-464c-982a-3be219596e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:06.230442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72aa37e-9113-464c-982a-3be219596e0a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:06.341893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 873/1746] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:11:06 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:06.346104 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2ecca-5f33-4a7e-901b-3fc3972925c9 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:06.359160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2ecca-5f33-4a7e-901b-3fc3972925c9 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:06.364892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75984e7-4762-4b81-ade9-b2674e7e24fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:06.368406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75984e7-4762-4b81-ade9-b2674e7e24fe admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:06.368406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75984e7-4762-4b81-ade9-b2674e7e24fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:06.368406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75984e7-4762-4b81-ade9-b2674e7e24fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:06.368406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75984e7-4762-4b81-ade9-b2674e7e24fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:06.368886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75984e7-4762-4b81-ade9-b2674e7e24fe admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:06.383974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 874/1747] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:06.387913 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72aa37e-9113-464c-982a-3be219596e0a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:06.395524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:06.399516 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72aa37e-9113-464c-982a-3be219596e0a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:06.407251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25e990-8384-4920-bbac-8b34de358d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:06.407872 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e990-8384-4920-bbac-8b34de358d71 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:06.408409 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e990-8384-4920-bbac-8b34de358d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:06.408582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e990-8384-4920-bbac-8b34de358d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:06.409205 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25e990-8384-4920-bbac-8b34de358d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:06.410836 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25e990-8384-4920-bbac-8b34de358d71 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:06.437713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 874/1748] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:06.441852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75984e7-4762-4b81-ade9-b2674e7e24fe admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:06.454935 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75984e7-4762-4b81-ade9-b2674e7e24fe admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:06.461227 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474314a-6f9a-48ff-9f1c-85e836277fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:06.461925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474314a-6f9a-48ff-9f1c-85e836277fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:06.462208 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474314a-6f9a-48ff-9f1c-85e836277fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:06.462821 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474314a-6f9a-48ff-9f1c-85e836277fa0 admin admin] PATH_INFO: `/v3/projects/5d822134baca4e9c8efa43be6e9173e4/users/93e162bdf99c4ee1a6c6bb5803f0b11a/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:06.493827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474314a-6f9a-48ff-9f1c-85e836277fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d822134baca4e9c8efa43be6e9173e4, user_id=93e162bdf99c4ee1a6c6bb5803f0b11a, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:06.508217 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474314a-6f9a-48ff-9f1c-85e836277fa0 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:06.643292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 875/1749] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:06 2022] PUT /identity/v3/projects/5d822134baca4e9c8efa43be6e9173e4/users/93e162bdf99c4ee1a6c6bb5803f0b11a/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:06.654733 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cfb05-6864-4290-b5a1-0107781df08e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:06.655055 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cfb05-6864-4290-b5a1-0107781df08e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:06.655797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15cfb05-6864-4290-b5a1-0107781df08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:06.702830 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f15cfb05-6864-4290-b5a1-0107781df08e None None] MFA Rules not processed for user `93e162bdf99c4ee1a6c6bb5803f0b11a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:06.704738 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f15cfb05-6864-4290-b5a1-0107781df08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:06.799276 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 875/1750] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:06.809242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474314a-6f9a-48ff-9f1c-85e836277fa0 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:06.871825 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:06.890861 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474314a-6f9a-48ff-9f1c-85e836277fa0 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:06.897586 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc938e-3c4c-48a2-977b-a88510611edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:06.905058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc938e-3c4c-48a2-977b-a88510611edf admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:06.905058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc938e-3c4c-48a2-977b-a88510611edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:06.905058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc938e-3c4c-48a2-977b-a88510611edf admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:06.905058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc938e-3c4c-48a2-977b-a88510611edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:06.905058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc938e-3c4c-48a2-977b-a88510611edf admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:07.010987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 876/1751] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:11:06 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:11:07.015796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cfb05-6864-4290-b5a1-0107781df08e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:07.035435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15cfb05-6864-4290-b5a1-0107781df08e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:07.124223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa437a5b-c53f-4d29-ab1c-e5c928ff254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:07.125251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437a5b-c53f-4d29-ab1c-e5c928ff254f admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:07.125765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437a5b-c53f-4d29-ab1c-e5c928ff254f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:07.126384 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437a5b-c53f-4d29-ab1c-e5c928ff254f admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:07.127690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa437a5b-c53f-4d29-ab1c-e5c928ff254f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:07.135288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa437a5b-c53f-4d29-ab1c-e5c928ff254f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:07.257475 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 876/1752] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:11:07 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:07.261528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc938e-3c4c-48a2-977b-a88510611edf admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:07.283634 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc938e-3c4c-48a2-977b-a88510611edf admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:07.300873 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754d2ee-5172-4008-ae7c-8883380d9ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:07.301945 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754d2ee-5172-4008-ae7c-8883380d9ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:07.302185 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754d2ee-5172-4008-ae7c-8883380d9ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:07.302495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754d2ee-5172-4008-ae7c-8883380d9ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:07.304672 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754d2ee-5172-4008-ae7c-8883380d9ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:07.308834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754d2ee-5172-4008-ae7c-8883380d9ba0 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:07.355507 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 877/1753] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:07.358332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa437a5b-c53f-4d29-ab1c-e5c928ff254f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:07.375201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa437a5b-c53f-4d29-ab1c-e5c928ff254f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:07.389594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2110c-c019-41b6-8e02-25cce4d9fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:07.389594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2110c-c019-41b6-8e02-25cce4d9fe52 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:07.389594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2110c-c019-41b6-8e02-25cce4d9fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:07.389594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2110c-c019-41b6-8e02-25cce4d9fe52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:07.389966 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2110c-c019-41b6-8e02-25cce4d9fe52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:07.391317 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2110c-c019-41b6-8e02-25cce4d9fe52 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:07.395510 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7037bc8-0007-4541-b6ad-da4b38c29c5b None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:07.395790 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7037bc8-0007-4541-b6ad-da4b38c29c5b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:07.396061 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7037bc8-0007-4541-b6ad-da4b38c29c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:07.412122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 877/1754] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:07.418848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2110c-c019-41b6-8e02-25cce4d9fe52 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:07.441279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2110c-c019-41b6-8e02-25cce4d9fe52 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:07.451800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfd8e7-bb87-4c00-a145-2f18072f864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:07.452510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfd8e7-bb87-4c00-a145-2f18072f864d admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:07.452781 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfd8e7-bb87-4c00-a145-2f18072f864d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:07.453047 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfd8e7-bb87-4c00-a145-2f18072f864d admin admin] PATH_INFO: `/v3/projects/c35435bbb4854c43befa452d06aebfbc/users/6c716d2b001744599b9828c013474c9b/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:07.461671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e7037bc8-0007-4541-b6ad-da4b38c29c5b None None] MFA Rules not processed for user `fc85e65bf89042f6b79dd93f3ee47443`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:07.463876 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e7037bc8-0007-4541-b6ad-da4b38c29c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:07.482123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfd8e7-bb87-4c00-a145-2f18072f864d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35435bbb4854c43befa452d06aebfbc, user_id=6c716d2b001744599b9828c013474c9b, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:07.485173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfd8e7-bb87-4c00-a145-2f18072f864d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:07.559427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 878/1755] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:07 2022] PUT /identity/v3/projects/c35435bbb4854c43befa452d06aebfbc/users/6c716d2b001744599b9828c013474c9b/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:07.565388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 878/1756] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:07.569772 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfd8e7-bb87-4c00-a145-2f18072f864d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:07.571496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076821e6-86e0-4340-8031-9077fbded714 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:07.571773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-70dfd8e7-bb87-4c00-a145-2f18072f864d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:07.571898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076821e6-86e0-4340-8031-9077fbded714 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:07.572044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076821e6-86e0-4340-8031-9077fbded714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:07.608905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-076821e6-86e0-4340-8031-9077fbded714 None None] MFA Rules not processed for user `6c716d2b001744599b9828c013474c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:07.610558 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-076821e6-86e0-4340-8031-9077fbded714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:07.651855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfd8e7-bb87-4c00-a145-2f18072f864d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:07.657586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451861f6-bd36-4ae6-a6bd-e19e07349507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:07.658250 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451861f6-bd36-4ae6-a6bd-e19e07349507 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:07.658532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451861f6-bd36-4ae6-a6bd-e19e07349507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:07.658801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451861f6-bd36-4ae6-a6bd-e19e07349507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:07.659505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451861f6-bd36-4ae6-a6bd-e19e07349507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:07.661435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451861f6-bd36-4ae6-a6bd-e19e07349507 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:07.690202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 879/1757] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:11:07.704652 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076821e6-86e0-4340-8031-9077fbded714 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:07.721798 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076821e6-86e0-4340-8031-9077fbded714 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:07.727963 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceebce7-9186-49ad-bb61-6db4911d9bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:07.728578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceebce7-9186-49ad-bb61-6db4911d9bcd admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:07.728853 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceebce7-9186-49ad-bb61-6db4911d9bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:07.729168 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceebce7-9186-49ad-bb61-6db4911d9bcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:07.729832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceebce7-9186-49ad-bb61-6db4911d9bcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:07.731729 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceebce7-9186-49ad-bb61-6db4911d9bcd admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:07.776307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 879/1758] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:11:07 2022] POST /identity/v3/projects => generated 381 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:07.781641 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451861f6-bd36-4ae6-a6bd-e19e07349507 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:07.868304 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451861f6-bd36-4ae6-a6bd-e19e07349507 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:07.870792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 880/1759] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:11:07 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:07.876269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceebce7-9186-49ad-bb61-6db4911d9bcd admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:07.876919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8df36-aab4-418d-ba9f-bad5efdda391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:07.877672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8df36-aab4-418d-ba9f-bad5efdda391 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:07.878193 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8df36-aab4-418d-ba9f-bad5efdda391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:07.878560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8df36-aab4-418d-ba9f-bad5efdda391 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:07.879455 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8df36-aab4-418d-ba9f-bad5efdda391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:07.881954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8df36-aab4-418d-ba9f-bad5efdda391 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:07.995003 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceebce7-9186-49ad-bb61-6db4911d9bcd admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:08.000329 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46ff9d-7240-418d-bed8-7c8edfea165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:08.001043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46ff9d-7240-418d-bed8-7c8edfea165d admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:08.001351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46ff9d-7240-418d-bed8-7c8edfea165d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:08.001627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46ff9d-7240-418d-bed8-7c8edfea165d admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:08.002270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46ff9d-7240-418d-bed8-7c8edfea165d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:08.004321 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46ff9d-7240-418d-bed8-7c8edfea165d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:08.110823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 880/1760] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:11:07 2022] POST /identity/v3/users => generated 297 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:11:08.115041 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8df36-aab4-418d-ba9f-bad5efdda391 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:08.131542 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8df36-aab4-418d-ba9f-bad5efdda391 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:08.136458 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdda8f-67ad-44d6-a1bc-c5f0dc8d770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:08.137067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdda8f-67ad-44d6-a1bc-c5f0dc8d770b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:08.137380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdda8f-67ad-44d6-a1bc-c5f0dc8d770b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:08.137651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdda8f-67ad-44d6-a1bc-c5f0dc8d770b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:08.139007 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdda8f-67ad-44d6-a1bc-c5f0dc8d770b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:08.141312 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdda8f-67ad-44d6-a1bc-c5f0dc8d770b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:08.160796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 881/1761] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:08.162110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdda8f-67ad-44d6-a1bc-c5f0dc8d770b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:08.173918 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdda8f-67ad-44d6-a1bc-c5f0dc8d770b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:08.179267 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2ef33-08de-40fb-ae3e-4a28ec51f7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:08.180082 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2ef33-08de-40fb-ae3e-4a28ec51f7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:08.180266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2ef33-08de-40fb-ae3e-4a28ec51f7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:08.180530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2ef33-08de-40fb-ae3e-4a28ec51f7c1 admin admin] PATH_INFO: `/v3/projects/356845cb4649475f97837ce037f32677/users/0cffb78189f44137bca684f3ee396845/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:08.203605 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2ef33-08de-40fb-ae3e-4a28ec51f7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356845cb4649475f97837ce037f32677, user_id=0cffb78189f44137bca684f3ee396845, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:08.207094 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 881/1762] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:11:07 2022] POST /identity/v3/users => generated 298 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:11:08.207242 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2ef33-08de-40fb-ae3e-4a28ec51f7c1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:08.208701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46ff9d-7240-418d-bed8-7c8edfea165d admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:08.222030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46ff9d-7240-418d-bed8-7c8edfea165d admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:08.231530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15f334-ae59-40ee-8f1f-7168c037b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:08.231530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15f334-ae59-40ee-8f1f-7168c037b5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:08.231530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15f334-ae59-40ee-8f1f-7168c037b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:08.231530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15f334-ae59-40ee-8f1f-7168c037b5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:08.231954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15f334-ae59-40ee-8f1f-7168c037b5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:08.231954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15f334-ae59-40ee-8f1f-7168c037b5f8 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:08.247980 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 882/1763] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:08.251956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15f334-ae59-40ee-8f1f-7168c037b5f8 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:08.262308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15f334-ae59-40ee-8f1f-7168c037b5f8 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:08.271242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dda631-ea3d-4f27-9983-f8e28feea0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:08.271937 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dda631-ea3d-4f27-9983-f8e28feea0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:08.272217 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dda631-ea3d-4f27-9983-f8e28feea0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:08.272488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dda631-ea3d-4f27-9983-f8e28feea0e5 admin admin] PATH_INFO: `/v3/projects/cd5f9fede94a4e46976bf7d145dc3fa9/users/a3a0216808e74466bb27d582a828e16d/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:08.307543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dda631-ea3d-4f27-9983-f8e28feea0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5f9fede94a4e46976bf7d145dc3fa9, user_id=a3a0216808e74466bb27d582a828e16d, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:08.311370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dda631-ea3d-4f27-9983-f8e28feea0e5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:08.317352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:08.337835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 882/1764] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:08 2022] PUT /identity/v3/projects/356845cb4649475f97837ce037f32677/users/0cffb78189f44137bca684f3ee396845/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:11:08.344911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2ef33-08de-40fb-ae3e-4a28ec51f7c1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:08.417717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 883/1765] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:08 2022] PUT /identity/v3/projects/cd5f9fede94a4e46976bf7d145dc3fa9/users/a3a0216808e74466bb27d582a828e16d/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:11:08.422027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dda631-ea3d-4f27-9983-f8e28feea0e5 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:08.429659 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2ef33-08de-40fb-ae3e-4a28ec51f7c1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:08.523545 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e831e-4bd9-4f00-9bd4-1b864cef7a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:08.524284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e831e-4bd9-4f00-9bd4-1b864cef7a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:08.524834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e831e-4bd9-4f00-9bd4-1b864cef7a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:08.526020 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e831e-4bd9-4f00-9bd4-1b864cef7a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:08.526020 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e831e-4bd9-4f00-9bd4-1b864cef7a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:08.527954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e831e-4bd9-4f00-9bd4-1b864cef7a3c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:08.548208 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dda631-ea3d-4f27-9983-f8e28feea0e5 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:08.549263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 883/1766] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:11:08.554446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e831e-4bd9-4f00-9bd4-1b864cef7a3c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:08.556547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849ddb6-edbe-43f5-ad3b-bb8da679d7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:08.557410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849ddb6-edbe-43f5-ad3b-bb8da679d7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:08.558885 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:08.559310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849ddb6-edbe-43f5-ad3b-bb8da679d7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:08.559726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849ddb6-edbe-43f5-ad3b-bb8da679d7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:08.560661 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849ddb6-edbe-43f5-ad3b-bb8da679d7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:08.562572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849ddb6-edbe-43f5-ad3b-bb8da679d7b7 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:08.574088 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 884/1767] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:08.577548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e831e-4bd9-4f00-9bd4-1b864cef7a3c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:08.589048 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849ddb6-edbe-43f5-ad3b-bb8da679d7b7 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:08.595484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7268c-1ace-43b6-99a8-8102515af8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:08.601451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7268c-1ace-43b6-99a8-8102515af8ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:08.601451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7268c-1ace-43b6-99a8-8102515af8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:08.601451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7268c-1ace-43b6-99a8-8102515af8ed admin admin] PATH_INFO: `/v3/projects/356845cb4649475f97837ce037f32677/users/0cffb78189f44137bca684f3ee396845/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:08.601451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7268c-1ace-43b6-99a8-8102515af8ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=356845cb4649475f97837ce037f32677, user_id=0cffb78189f44137bca684f3ee396845, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:08.601451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7268c-1ace-43b6-99a8-8102515af8ed admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:08.604953 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849ddb6-edbe-43f5-ad3b-bb8da679d7b7 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:08.610918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631670b-4682-4a93-bca3-1841696d4f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:08.611706 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631670b-4682-4a93-bca3-1841696d4f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:08.612100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631670b-4682-4a93-bca3-1841696d4f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:08.612466 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631670b-4682-4a93-bca3-1841696d4f9f admin admin] PATH_INFO: `/v3/projects/cd5f9fede94a4e46976bf7d145dc3fa9/users/a3a0216808e74466bb27d582a828e16d/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:08.614739 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631670b-4682-4a93-bca3-1841696d4f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5f9fede94a4e46976bf7d145dc3fa9, user_id=a3a0216808e74466bb27d582a828e16d, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:08.617072 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 884/1768] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:08 2022] PUT /identity/v3/projects/356845cb4649475f97837ce037f32677/users/0cffb78189f44137bca684f3ee396845/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:08.621608 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631670b-4682-4a93-bca3-1841696d4f9f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:08.638274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 885/1769] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:08 2022] PUT /identity/v3/projects/cd5f9fede94a4e46976bf7d145dc3fa9/users/a3a0216808e74466bb27d582a828e16d/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:08.648844 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5447a6-dc24-4898-8f7a-6cb443253ceb None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:08.649125 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5447a6-dc24-4898-8f7a-6cb443253ceb None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:08.649434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5447a6-dc24-4898-8f7a-6cb443253ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:08.679263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fd5447a6-dc24-4898-8f7a-6cb443253ceb None None] MFA Rules not processed for user `a3a0216808e74466bb27d582a828e16d`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:08.680480 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fd5447a6-dc24-4898-8f7a-6cb443253ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:08.759644 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 885/1770] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:11:08.771562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631670b-4682-4a93-bca3-1841696d4f9f admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:08.784753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a631670b-4682-4a93-bca3-1841696d4f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:08.856366 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631670b-4682-4a93-bca3-1841696d4f9f admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:08.868026 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f710ee-e92d-468a-8684-fef43e9e4b13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:08.868026 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f710ee-e92d-468a-8684-fef43e9e4b13 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:08.868319 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f710ee-e92d-468a-8684-fef43e9e4b13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:08.868319 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f710ee-e92d-468a-8684-fef43e9e4b13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:08.916017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:08.984104 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f710ee-e92d-468a-8684-fef43e9e4b13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:08.985799 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f710ee-e92d-468a-8684-fef43e9e4b13 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:08.995662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 886/1771] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:09.196109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:12.287945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5447a6-dc24-4898-8f7a-6cb443253ceb None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:12.302242 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5447a6-dc24-4898-8f7a-6cb443253ceb None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:12.307083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647b362-1f18-4815-8986-14509782fb8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:12.307888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647b362-1f18-4815-8986-14509782fb8d service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:12.308351 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647b362-1f18-4815-8986-14509782fb8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:12.308616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647b362-1f18-4815-8986-14509782fb8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:12.394837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647b362-1f18-4815-8986-14509782fb8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:12.396564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647b362-1f18-4815-8986-14509782fb8d service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:12.407388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 886/1772] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:14.436265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f710ee-e92d-468a-8684-fef43e9e4b13 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:14.446748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f710ee-e92d-468a-8684-fef43e9e4b13 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:14.457547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ff1aa-cec3-4a6f-8825-c1bfa28a54dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:14.458248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ff1aa-cec3-4a6f-8825-c1bfa28a54dd service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:14.458597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ff1aa-cec3-4a6f-8825-c1bfa28a54dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:14.458938 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ff1aa-cec3-4a6f-8825-c1bfa28a54dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:14.472846 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ff1aa-cec3-4a6f-8825-c1bfa28a54dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:14.475206 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ff1aa-cec3-4a6f-8825-c1bfa28a54dd service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:14.489464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 887/1773] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:14.781918 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddf4b3-f8c7-4ef4-87b3-cb36f72fa988 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:14.782689 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddf4b3-f8c7-4ef4-87b3-cb36f72fa988 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:14.782976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddf4b3-f8c7-4ef4-87b3-cb36f72fa988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:14.817372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fbddf4b3-f8c7-4ef4-87b3-cb36f72fa988 None None] MFA Rules not processed for user `0cffb78189f44137bca684f3ee396845`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:14.818712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fbddf4b3-f8c7-4ef4-87b3-cb36f72fa988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:14.839682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:14.907323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 887/1774] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:14.916682 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ff1aa-cec3-4a6f-8825-c1bfa28a54dd service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:14.918241 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d60ff1aa-cec3-4a6f-8825-c1bfa28a54dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:14.991647 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ff1aa-cec3-4a6f-8825-c1bfa28a54dd service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:14.995579 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b7f21-203f-41fc-8169-cdbd8911bd03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74317ae6b47843de85d03f3a9d3a811d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:14.996193 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b7f21-203f-41fc-8169-cdbd8911bd03 service glance] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:14.996468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b7f21-203f-41fc-8169-cdbd8911bd03 service glance] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:14.996738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b7f21-203f-41fc-8169-cdbd8911bd03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:15.056938 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b7f21-203f-41fc-8169-cdbd8911bd03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:15.058427 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b7f21-203f-41fc-8169-cdbd8911bd03 service glance] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:15.068897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 888/1775] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:15.583373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bdb1e-d984-4b13-838e-dbe3fed2c7e2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:15.583689 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bdb1e-d984-4b13-838e-dbe3fed2c7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:15.583965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bdb1e-d984-4b13-838e-dbe3fed2c7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:15.608428 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fa5bdb1e-d984-4b13-838e-dbe3fed2c7e2 None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:15.609743 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fa5bdb1e-d984-4b13-838e-dbe3fed2c7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:15.670688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 888/1776] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:11:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:15.717413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b7f21-203f-41fc-8169-cdbd8911bd03 service glance] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:15.719457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a15b7f21-203f-41fc-8169-cdbd8911bd03 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:15.807981 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:15.832492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b7f21-203f-41fc-8169-cdbd8911bd03 service glance] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:15.832492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234d926-cea1-4522-9caf-0d406dca3921 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:15.832492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234d926-cea1-4522-9caf-0d406dca3921 service swift] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:15.832492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234d926-cea1-4522-9caf-0d406dca3921 service swift] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:15.832944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234d926-cea1-4522-9caf-0d406dca3921 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:15.844132 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234d926-cea1-4522-9caf-0d406dca3921 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:15.845934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234d926-cea1-4522-9caf-0d406dca3921 service swift] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:15.858518 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 889/1777] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:11:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:11:21.388349 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bdb1e-d984-4b13-838e-dbe3fed2c7e2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:21.476078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bdb1e-d984-4b13-838e-dbe3fed2c7e2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:21.483669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:21.485511 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:21.485964 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:21.486427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] PATH_INFO: `/v3/users/93e162bdf99c4ee1a6c6bb5803f0b11a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:21.487710 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e162bdf99c4ee1a6c6bb5803f0b11a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:21.489759 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:21.653932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e162bdf99c4ee1a6c6bb5803f0b11a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:21.654611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e162bdf99c4ee1a6c6bb5803f0b11a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:21.668301 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e162bdf99c4ee1a6c6bb5803f0b11a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:21.785935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e162bdf99c4ee1a6c6bb5803f0b11a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:21.790568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:21.804340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e162bdf99c4ee1a6c6bb5803f0b11a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:21.817216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 889/1778] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:11:21 2022] DELETE /identity/v3/users/93e162bdf99c4ee1a6c6bb5803f0b11a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:21.818865 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a556d-a500-4ea3-8d7c-0bd0f13e81dd None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:21.819383 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a556d-a500-4ea3-8d7c-0bd0f13e81dd None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:21.819383 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a556d-a500-4ea3-8d7c-0bd0f13e81dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:21.839181 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f53a556d-a500-4ea3-8d7c-0bd0f13e81dd None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:21.840658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f53a556d-a500-4ea3-8d7c-0bd0f13e81dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:21.912058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 890/1779] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:11:21.922406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:21.923875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:21.999314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fcb13-2540-46a8-9ad8-f93d1292739b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:22.003319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7c682-0eca-4a4e-868f-0f29e710cb8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:22.006878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7c682-0eca-4a4e-868f-0f29e710cb8d service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:22.006878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7c682-0eca-4a4e-868f-0f29e710cb8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:22.006878 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7c682-0eca-4a4e-868f-0f29e710cb8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:22.016579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7c682-0eca-4a4e-868f-0f29e710cb8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:22.018148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7c682-0eca-4a4e-868f-0f29e710cb8d service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:22.029170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 890/1780] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:23.452405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a556d-a500-4ea3-8d7c-0bd0f13e81dd None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:23.461373 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f53a556d-a500-4ea3-8d7c-0bd0f13e81dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:23.489499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a556d-a500-4ea3-8d7c-0bd0f13e81dd None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:23.504097 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:23.506228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:23.506720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:23.507245 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] PATH_INFO: `/v3/projects/5d822134baca4e9c8efa43be6e9173e4` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:23.522991 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d822134baca4e9c8efa43be6e9173e4)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:23.525663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:23.670407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d822134baca4e9c8efa43be6e9173e4', 'request_id': 'req-6af8149e-5a90-4984-80be-548d0f85c925'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:23.756414 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d822134baca4e9c8efa43be6e9173e4', 'request_id': 'req-6af8149e-5a90-4984-80be-548d0f85c925'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:23.764993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d822134baca4e9c8efa43be6e9173e4', 'request_id': 'req-6af8149e-5a90-4984-80be-548d0f85c925'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:23.780860 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] The token cache is being invalidate because project 5d822134baca4e9c8efa43be6e9173e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:11:23.781220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:23.781947 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:23.783503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 891/1781] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:11:23 2022] DELETE /identity/v3/projects/5d822134baca4e9c8efa43be6e9173e4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:23.787681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7c682-0eca-4a4e-868f-0f29e710cb8d service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:23.801722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7c682-0eca-4a4e-868f-0f29e710cb8d service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:23.880326 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:23.881194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:23.881503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:23.881820 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] PATH_INFO: `/v3/users/6c716d2b001744599b9828c013474c9b` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:23.883140 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c716d2b001744599b9828c013474c9b)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:23.885069 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:24.174862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c716d2b001744599b9828c013474c9b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:24.177006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c716d2b001744599b9828c013474c9b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:24.203355 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c716d2b001744599b9828c013474c9b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:24.322402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c716d2b001744599b9828c013474c9b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:24.362552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c716d2b001744599b9828c013474c9b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:24.373227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 891/1782] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:11:23 2022] DELETE /identity/v3/users/6c716d2b001744599b9828c013474c9b => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:25.360296 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:25.360296 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:25.377168 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8149e-5a90-4984-80be-548d0f85c925 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:25.489830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:25.490679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:25.490956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:25.491225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] PATH_INFO: `/v3/projects/c35435bbb4854c43befa452d06aebfbc` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:25.493650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c35435bbb4854c43befa452d06aebfbc)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:25.496087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:25.511438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:25.687557 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35435bbb4854c43befa452d06aebfbc', 'request_id': 'req-e76fbb0f-92b7-415c-935d-eee226481bd5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:25.745188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35435bbb4854c43befa452d06aebfbc', 'request_id': 'req-e76fbb0f-92b7-415c-935d-eee226481bd5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:25.753978 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35435bbb4854c43befa452d06aebfbc', 'request_id': 'req-e76fbb0f-92b7-415c-935d-eee226481bd5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:25.766701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] The token cache is being invalidate because project c35435bbb4854c43befa452d06aebfbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:11:25.767300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:25.768026 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:25.772572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 892/1783] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:11:25 2022] DELETE /identity/v3/projects/c35435bbb4854c43befa452d06aebfbc => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:25.773860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:25.776144 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:25.787286 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:25.794363 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0cbdf-1874-419f-8b1e-fa27459b1ec8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:25.860847 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45622cae-841d-4231-b651-25d9568ead2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:25.861483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622cae-841d-4231-b651-25d9568ead2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:25.861890 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622cae-841d-4231-b651-25d9568ead2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:25.862166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45622cae-841d-4231-b651-25d9568ead2a admin admin] PATH_INFO: `/v3/users/a3a0216808e74466bb27d582a828e16d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:25.863341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45622cae-841d-4231-b651-25d9568ead2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a0216808e74466bb27d582a828e16d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:25.867347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45622cae-841d-4231-b651-25d9568ead2a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:26.115998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45622cae-841d-4231-b651-25d9568ead2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a0216808e74466bb27d582a828e16d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:26.116770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45622cae-841d-4231-b651-25d9568ead2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a0216808e74466bb27d582a828e16d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:26.139718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45622cae-841d-4231-b651-25d9568ead2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a0216808e74466bb27d582a828e16d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:26.226703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45622cae-841d-4231-b651-25d9568ead2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a0216808e74466bb27d582a828e16d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:26.235714 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-45622cae-841d-4231-b651-25d9568ead2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a0216808e74466bb27d582a828e16d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:26.242300 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 892/1784] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:11:25 2022] DELETE /identity/v3/users/a3a0216808e74466bb27d582a828e16d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:11:27.118013 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:27.118013 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:27.127487 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fbb0f-92b7-415c-935d-eee226481bd5 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:27.234615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56acd0e-df41-402a-be62-40729b5869f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:27.235548 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56acd0e-df41-402a-be62-40729b5869f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:27.236133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56acd0e-df41-402a-be62-40729b5869f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:27.236556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56acd0e-df41-402a-be62-40729b5869f8 admin admin] PATH_INFO: `/v3/projects/cd5f9fede94a4e46976bf7d145dc3fa9` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:27.242071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56acd0e-df41-402a-be62-40729b5869f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5f9fede94a4e46976bf7d145dc3fa9)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:27.244441 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56acd0e-df41-402a-be62-40729b5869f8 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:27.429666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-b56acd0e-df41-402a-be62-40729b5869f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5f9fede94a4e46976bf7d145dc3fa9', 'request_id': 'req-b56acd0e-df41-402a-be62-40729b5869f8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:27.539924 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-b56acd0e-df41-402a-be62-40729b5869f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5f9fede94a4e46976bf7d145dc3fa9', 'request_id': 'req-b56acd0e-df41-402a-be62-40729b5869f8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:27.548154 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-b56acd0e-df41-402a-be62-40729b5869f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5f9fede94a4e46976bf7d145dc3fa9', 'request_id': 'req-b56acd0e-df41-402a-be62-40729b5869f8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:27.559973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-b56acd0e-df41-402a-be62-40729b5869f8 admin admin] The token cache is being invalidate because project cd5f9fede94a4e46976bf7d145dc3fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:11:27.560426 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-b56acd0e-df41-402a-be62-40729b5869f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:27.561178 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-b56acd0e-df41-402a-be62-40729b5869f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:27.562797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 893/1785] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:11:27 2022] DELETE /identity/v3/projects/cd5f9fede94a4e46976bf7d145dc3fa9 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:27.568047 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac9386-9d9b-4c9d-8025-2724a0410a31 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:27.568618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac9386-9d9b-4c9d-8025-2724a0410a31 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:27.568618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac9386-9d9b-4c9d-8025-2724a0410a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:27.592465 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5bac9386-9d9b-4c9d-8025-2724a0410a31 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:27.594171 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5bac9386-9d9b-4c9d-8025-2724a0410a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:27.655260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 893/1786] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:27.663308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafff160-94e4-460e-9b97-843f4af9a5be None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:27.663587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafff160-94e4-460e-9b97-843f4af9a5be None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:27.663857 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafff160-94e4-460e-9b97-843f4af9a5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:27.684133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-aafff160-94e4-460e-9b97-843f4af9a5be None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:27.685593 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-aafff160-94e4-460e-9b97-843f4af9a5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:27.693391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 894/1787] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:11:27.697450 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac9386-9d9b-4c9d-8025-2724a0410a31 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:27.707687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac9386-9d9b-4c9d-8025-2724a0410a31 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:27.712302 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c3f69-0e81-4459-88c9-b048fc4f1eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:27.712901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c3f69-0e81-4459-88c9-b048fc4f1eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:27.713183 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c3f69-0e81-4459-88c9-b048fc4f1eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:27.713488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c3f69-0e81-4459-88c9-b048fc4f1eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:27.714138 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c3f69-0e81-4459-88c9-b048fc4f1eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:11:27.714433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c3f69-0e81-4459-88c9-b048fc4f1eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:27.716041 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c3f69-0e81-4459-88c9-b048fc4f1eb5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:27.729205 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 894/1788] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:11:27.734026 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafff160-94e4-460e-9b97-843f4af9a5be None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:27.743657 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafff160-94e4-460e-9b97-843f4af9a5be None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:27.748658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97754a-bbcf-4aad-b234-bde2b8103584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:27.749255 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97754a-bbcf-4aad-b234-bde2b8103584 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:27.749553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97754a-bbcf-4aad-b234-bde2b8103584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:27.749817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97754a-bbcf-4aad-b234-bde2b8103584 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:27.750532 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97754a-bbcf-4aad-b234-bde2b8103584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:27.752514 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97754a-bbcf-4aad-b234-bde2b8103584 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:27.839344 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:27.845167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 895/1789] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:11:27 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:27.849025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c3f69-0e81-4459-88c9-b048fc4f1eb5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:27.860227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c3f69-0e81-4459-88c9-b048fc4f1eb5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:27.865679 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:27.917065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5ad63-682d-436d-b29e-9465712ffd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:27.917732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5ad63-682d-436d-b29e-9465712ffd76 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:27.918524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5ad63-682d-436d-b29e-9465712ffd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:27.918825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5ad63-682d-436d-b29e-9465712ffd76 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:27.919460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5ad63-682d-436d-b29e-9465712ffd76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:27.921396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5ad63-682d-436d-b29e-9465712ffd76 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:28.047925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 895/1790] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:11:27 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:28.053827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97754a-bbcf-4aad-b234-bde2b8103584 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:28.064599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97754a-bbcf-4aad-b234-bde2b8103584 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:28.069146 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b65e9e-cc81-4e12-a96b-694ab9521a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:28.069760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b65e9e-cc81-4e12-a96b-694ab9521a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:28.070036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b65e9e-cc81-4e12-a96b-694ab9521a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:28.070302 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b65e9e-cc81-4e12-a96b-694ab9521a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:28.070939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b65e9e-cc81-4e12-a96b-694ab9521a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:28.072519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b65e9e-cc81-4e12-a96b-694ab9521a04 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:28.083081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 896/1791] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:28.098047 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5ad63-682d-436d-b29e-9465712ffd76 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:28.108006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5ad63-682d-436d-b29e-9465712ffd76 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:28.112603 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66896228-a381-4f01-863e-5594d87d5529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:28.113191 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66896228-a381-4f01-863e-5594d87d5529 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:28.113502 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66896228-a381-4f01-863e-5594d87d5529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:28.113771 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66896228-a381-4f01-863e-5594d87d5529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:28.114404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66896228-a381-4f01-863e-5594d87d5529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:28.115974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66896228-a381-4f01-863e-5594d87d5529 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:28.128031 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 896/1792] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:28.138875 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b65e9e-cc81-4e12-a96b-694ab9521a04 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:28.143635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b65e9e-cc81-4e12-a96b-694ab9521a04 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:28.148280 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81169f-5315-4264-9117-9561604bc4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:28.148883 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81169f-5315-4264-9117-9561604bc4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:28.149155 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81169f-5315-4264-9117-9561604bc4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:28.149463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81169f-5315-4264-9117-9561604bc4f7 admin admin] PATH_INFO: `/v3/projects/1dc3e134a6904df9b652dc857efc31c0/users/439c5a2ae9bb433489b2424505eed9ad/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:28.165003 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81169f-5315-4264-9117-9561604bc4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc3e134a6904df9b652dc857efc31c0, user_id=439c5a2ae9bb433489b2424505eed9ad, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:28.167680 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81169f-5315-4264-9117-9561604bc4f7 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:28.305462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 897/1793] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:28 2022] PUT /identity/v3/projects/1dc3e134a6904df9b652dc857efc31c0/users/439c5a2ae9bb433489b2424505eed9ad/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:28.311173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c369a-05aa-419a-b07a-0ae5521a790f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:28.311451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c369a-05aa-419a-b07a-0ae5521a790f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:28.311723 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c369a-05aa-419a-b07a-0ae5521a790f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:28.330577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-bf5c369a-05aa-419a-b07a-0ae5521a790f None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:28.331817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bf5c369a-05aa-419a-b07a-0ae5521a790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:28.374701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a644b-263c-48d2-a3a7-ff8832ebfef4 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:28.375185 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a644b-263c-48d2-a3a7-ff8832ebfef4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:28.375562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a644b-263c-48d2-a3a7-ff8832ebfef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:28.396571 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-cf2a644b-263c-48d2-a3a7-ff8832ebfef4 None None] MFA Rules not processed for user `fc85e65bf89042f6b79dd93f3ee47443`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:28.396741 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 897/1794] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:28.398287 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-cf2a644b-263c-48d2-a3a7-ff8832ebfef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:28.406909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c369a-05aa-419a-b07a-0ae5521a790f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:28.408988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bf5c369a-05aa-419a-b07a-0ae5521a790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:28.483380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c369a-05aa-419a-b07a-0ae5521a790f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:28.488763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e12d98-b416-4b53-8621-d446527a16ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:28.489627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 898/1795] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:11:28.494279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e12d98-b416-4b53-8621-d446527a16ff service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:28.494629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e12d98-b416-4b53-8621-d446527a16ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:28.494995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e12d98-b416-4b53-8621-d446527a16ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:28.510240 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e12d98-b416-4b53-8621-d446527a16ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:28.511692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e12d98-b416-4b53-8621-d446527a16ff service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:28.529984 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 898/1796] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:11:30.214991 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648be60a-7e96-486f-aff3-19c3bc9739af None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:30.215528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648be60a-7e96-486f-aff3-19c3bc9739af None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:30.215528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648be60a-7e96-486f-aff3-19c3bc9739af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:30.257937 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-648be60a-7e96-486f-aff3-19c3bc9739af None None] MFA Rules not processed for user `439c5a2ae9bb433489b2424505eed9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:30.259365 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-648be60a-7e96-486f-aff3-19c3bc9739af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:30.330209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 899/1797] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:30.689872 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e12d98-b416-4b53-8621-d446527a16ff service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:30.691307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a7e12d98-b416-4b53-8621-d446527a16ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:30.726180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:30.749577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e12d98-b416-4b53-8621-d446527a16ff service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:30.753112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c332a4-2136-4fca-99ff-094a5570eab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:30.753739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c332a4-2136-4fca-99ff-094a5570eab2 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:30.754012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c332a4-2136-4fca-99ff-094a5570eab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:30.754282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c332a4-2136-4fca-99ff-094a5570eab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:30.762311 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c332a4-2136-4fca-99ff-094a5570eab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:30.763808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c332a4-2136-4fca-99ff-094a5570eab2 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:30.795363 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 899/1798] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:30.816861 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648be60a-7e96-486f-aff3-19c3bc9739af None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:30.818512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-648be60a-7e96-486f-aff3-19c3bc9739af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:30.848371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648be60a-7e96-486f-aff3-19c3bc9739af None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:30.857681 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:30.858356 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:30.858654 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:30.858880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] PATH_INFO: `/v3/users/fc8b820854514a08a012a97b14324365` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:30.886636 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8b820854514a08a012a97b14324365)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:30.886636 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:31.158622 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8b820854514a08a012a97b14324365'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:31.159268 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8b820854514a08a012a97b14324365'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:31.164474 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:31.172614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8b820854514a08a012a97b14324365'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:31.173203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8b820854514a08a012a97b14324365'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:31.236035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8b820854514a08a012a97b14324365'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:31.248612 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 900/1799] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:11:30 2022] DELETE /identity/v3/users/fc8b820854514a08a012a97b14324365 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:31.253146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c12a21-bb41-46ea-82b4-4e2e6f3529df None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:31.253518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c12a21-bb41-46ea-82b4-4e2e6f3529df None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:31.253850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c12a21-bb41-46ea-82b4-4e2e6f3529df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:31.273814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b8c12a21-bb41-46ea-82b4-4e2e6f3529df None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:31.275025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b8c12a21-bb41-46ea-82b4-4e2e6f3529df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:31.336207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 900/1800] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:31.346779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:31.348318 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:31.406386 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22118299-e3fe-4963-a35b-c0210e74d48a admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:31.409925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f2c4e-50c4-4238-8904-706c21d465dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:31.410204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2c4e-50c4-4238-8904-706c21d465dc service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:31.410483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2c4e-50c4-4238-8904-706c21d465dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:31.410751 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f2c4e-50c4-4238-8904-706c21d465dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:31.423822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f2c4e-50c4-4238-8904-706c21d465dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:31.425236 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f2c4e-50c4-4238-8904-706c21d465dc service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:31.436631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 901/1801] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:32.055453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c12a21-bb41-46ea-82b4-4e2e6f3529df None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:32.057323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b8c12a21-bb41-46ea-82b4-4e2e6f3529df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:32.072893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c12a21-bb41-46ea-82b4-4e2e6f3529df None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:32.078954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:32.079643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:32.079982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:32.080261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] PATH_INFO: `/v3/projects/c0fe3cd493b44b8abe006feaa20084dc` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:32.081459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0fe3cd493b44b8abe006feaa20084dc)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:32.083412 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:32.198469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0fe3cd493b44b8abe006feaa20084dc', 'request_id': 'req-db4d206d-ea05-430d-955f-806be6107f46'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:32.338151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0fe3cd493b44b8abe006feaa20084dc', 'request_id': 'req-db4d206d-ea05-430d-955f-806be6107f46'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:32.346013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0fe3cd493b44b8abe006feaa20084dc', 'request_id': 'req-db4d206d-ea05-430d-955f-806be6107f46'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:32.359713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] The token cache is being invalidate because project c0fe3cd493b44b8abe006feaa20084dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:11:32.360001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:32.360677 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:32.362197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 901/1802] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:11:32 2022] DELETE /identity/v3/projects/c0fe3cd493b44b8abe006feaa20084dc => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:33.254845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2e1d0-fd83-4502-a026-16b6f9e9f0a5 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:33.255310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2e1d0-fd83-4502-a026-16b6f9e9f0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:33.255399 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2e1d0-fd83-4502-a026-16b6f9e9f0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:33.275640 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-8fc2e1d0-fd83-4502-a026-16b6f9e9f0a5 None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:33.276765 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-8fc2e1d0-fd83-4502-a026-16b6f9e9f0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:33.340496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 902/1803] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:11:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:11:33.353707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:33.355189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:33.424737 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:33.440635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d206d-ea05-430d-955f-806be6107f46 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:33.449406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3758ff-35e1-4839-bdc3-06696042aec1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:33.450039 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3758ff-35e1-4839-bdc3-06696042aec1 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:33.450344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3758ff-35e1-4839-bdc3-06696042aec1 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:33.450795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3758ff-35e1-4839-bdc3-06696042aec1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:33.459712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3758ff-35e1-4839-bdc3-06696042aec1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:33.461382 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3758ff-35e1-4839-bdc3-06696042aec1 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:33.469892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 902/1804] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:11:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:11:33.733785 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5fbd2-8f37-42b2-87eb-a0ab4727403d None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:33.734480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5fbd2-8f37-42b2-87eb-a0ab4727403d None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:33.734895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5fbd2-8f37-42b2-87eb-a0ab4727403d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:33.774934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-66b5fbd2-8f37-42b2-87eb-a0ab4727403d None None] MFA Rules not processed for user `439c5a2ae9bb433489b2424505eed9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:33.776468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-66b5fbd2-8f37-42b2-87eb-a0ab4727403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:33.882730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 903/1805] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:36.455862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13ea6d-fa23-45e5-8842-2add5158b6d6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:36.456392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13ea6d-fa23-45e5-8842-2add5158b6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:36.456392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13ea6d-fa23-45e5-8842-2add5158b6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:36.478175 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1e13ea6d-fa23-45e5-8842-2add5158b6d6 None None] MFA Rules not processed for user `4adb546848a744b3a3ed4d77bc02c0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:36.479407 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1e13ea6d-fa23-45e5-8842-2add5158b6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:36.540150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 903/1806] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:39.130739 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5fbd2-8f37-42b2-87eb-a0ab4727403d None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:39.132360 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-66b5fbd2-8f37-42b2-87eb-a0ab4727403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:39.161464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:39.202333 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5fbd2-8f37-42b2-87eb-a0ab4727403d None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:39.207113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:39.207755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:39.208035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:39.208306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] PATH_INFO: `/v3/users/30156075f9c44c10a0b3b09f6d5431f5` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:39.209519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] RBAC: Authorizing `identity:delete_user(user_id=30156075f9c44c10a0b3b09f6d5431f5)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:39.211488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:39.531067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30156075f9c44c10a0b3b09f6d5431f5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:39.531882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30156075f9c44c10a0b3b09f6d5431f5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:39.545518 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30156075f9c44c10a0b3b09f6d5431f5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:39.546355 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30156075f9c44c10a0b3b09f6d5431f5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:39.647296 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30156075f9c44c10a0b3b09f6d5431f5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:39.665926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 904/1807] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:11:39 2022] DELETE /identity/v3/users/30156075f9c44c10a0b3b09f6d5431f5 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:39.671011 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92069c1-4a75-4bd6-95a0-209f242f20e7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:39.671856 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92069c1-4a75-4bd6-95a0-209f242f20e7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:39.672136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92069c1-4a75-4bd6-95a0-209f242f20e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:39.693471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d92069c1-4a75-4bd6-95a0-209f242f20e7 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:39.694683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d92069c1-4a75-4bd6-95a0-209f242f20e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:39.756417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 904/1808] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:39.766746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:39.768363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:39.829929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b903f-aba6-4b63-9cb3-7fbf2ca4c63a admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:39.833776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad0005-dd98-44d4-bf97-3c42aef309e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:39.834492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad0005-dd98-44d4-bf97-3c42aef309e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:39.834867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad0005-dd98-44d4-bf97-3c42aef309e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:39.835237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad0005-dd98-44d4-bf97-3c42aef309e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:39.851574 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad0005-dd98-44d4-bf97-3c42aef309e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:39.853310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad0005-dd98-44d4-bf97-3c42aef309e8 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:39.876278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 905/1809] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:40.364265 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92069c1-4a75-4bd6-95a0-209f242f20e7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:40.369004 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d92069c1-4a75-4bd6-95a0-209f242f20e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:40.383939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92069c1-4a75-4bd6-95a0-209f242f20e7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:40.389637 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:40.390260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:40.390572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:40.390786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] PATH_INFO: `/v3/projects/8c30300fe45646b8a889c7fa1ca2c7d2` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:40.392103 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c30300fe45646b8a889c7fa1ca2c7d2)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:40.394192 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:40.493173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c30300fe45646b8a889c7fa1ca2c7d2', 'request_id': 'req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:40.540064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c30300fe45646b8a889c7fa1ca2c7d2', 'request_id': 'req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:40.549673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c30300fe45646b8a889c7fa1ca2c7d2', 'request_id': 'req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:40.563025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] The token cache is being invalidate because project 8c30300fe45646b8a889c7fa1ca2c7d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:11:40.563435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:40.564354 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:40.566059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 905/1810] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:11:40 2022] DELETE /identity/v3/projects/8c30300fe45646b8a889c7fa1ca2c7d2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:11:40.570182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad0005-dd98-44d4-bf97-3c42aef309e8 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:40.583348 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad0005-dd98-44d4-bf97-3c42aef309e8 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:40.637235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:40.661823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10ebef-740a-43cc-b939-b53671c9b87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:40.662584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10ebef-740a-43cc-b939-b53671c9b87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:40.662957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10ebef-740a-43cc-b939-b53671c9b87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:40.663325 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10ebef-740a-43cc-b939-b53671c9b87f admin admin] PATH_INFO: `/v3/users/32a901a6d27c45f3bbbc7b8934ba41ac` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:40.664530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10ebef-740a-43cc-b939-b53671c9b87f admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a901a6d27c45f3bbbc7b8934ba41ac)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:40.666735 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10ebef-740a-43cc-b939-b53671c9b87f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:40.869854 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-1f10ebef-740a-43cc-b939-b53671c9b87f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a901a6d27c45f3bbbc7b8934ba41ac'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:40.870491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-1f10ebef-740a-43cc-b939-b53671c9b87f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a901a6d27c45f3bbbc7b8934ba41ac'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:40.882677 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-1f10ebef-740a-43cc-b939-b53671c9b87f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a901a6d27c45f3bbbc7b8934ba41ac'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:40.883326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-1f10ebef-740a-43cc-b939-b53671c9b87f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a901a6d27c45f3bbbc7b8934ba41ac'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:40.956024 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-1f10ebef-740a-43cc-b939-b53671c9b87f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a901a6d27c45f3bbbc7b8934ba41ac'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:40.986324 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 906/1811] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:11:40 2022] DELETE /identity/v3/users/32a901a6d27c45f3bbbc7b8934ba41ac => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:41.518048 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:41.522235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:41.535730 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87c8ae-e5f8-49d4-8f7b-4d8a3dc9bb96 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:41.548215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:41.597101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c64419-6ae5-491b-957f-62911b23c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:41.597938 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c64419-6ae5-491b-957f-62911b23c3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:41.598315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c64419-6ae5-491b-957f-62911b23c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:41.598684 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c64419-6ae5-491b-957f-62911b23c3fd admin admin] PATH_INFO: `/v3/projects/3b7811576192486197fedffb1c4e07ef` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:41.600052 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c64419-6ae5-491b-957f-62911b23c3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7811576192486197fedffb1c4e07ef)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:41.602132 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c64419-6ae5-491b-957f-62911b23c3fd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:41.696396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-06c64419-6ae5-491b-957f-62911b23c3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7811576192486197fedffb1c4e07ef', 'request_id': 'req-06c64419-6ae5-491b-957f-62911b23c3fd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:41.767131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-06c64419-6ae5-491b-957f-62911b23c3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7811576192486197fedffb1c4e07ef', 'request_id': 'req-06c64419-6ae5-491b-957f-62911b23c3fd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:41.774675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-06c64419-6ae5-491b-957f-62911b23c3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7811576192486197fedffb1c4e07ef', 'request_id': 'req-06c64419-6ae5-491b-957f-62911b23c3fd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:41.787241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-06c64419-6ae5-491b-957f-62911b23c3fd admin admin] The token cache is being invalidate because project 3b7811576192486197fedffb1c4e07ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:11:41.787535 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-06c64419-6ae5-491b-957f-62911b23c3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:41.788205 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-06c64419-6ae5-491b-957f-62911b23c3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:41.790476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 906/1812] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:11:41 2022] DELETE /identity/v3/projects/3b7811576192486197fedffb1c4e07ef => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:41.800775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886c2ae-eb6d-467a-8940-e17c5a8f7403 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:41.800775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886c2ae-eb6d-467a-8940-e17c5a8f7403 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:41.800775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886c2ae-eb6d-467a-8940-e17c5a8f7403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:41.827602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d886c2ae-eb6d-467a-8940-e17c5a8f7403 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:41.828967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d886c2ae-eb6d-467a-8940-e17c5a8f7403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:41.935979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 907/1813] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:41.939270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025372-cd95-4557-b418-1a6e76261861 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:41.939557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025372-cd95-4557-b418-1a6e76261861 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:41.939834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025372-cd95-4557-b418-1a6e76261861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:41.961081 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-96025372-cd95-4557-b418-1a6e76261861 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:41.962372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-96025372-cd95-4557-b418-1a6e76261861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:41.982517 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 907/1814] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:11:41.983441 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886c2ae-eb6d-467a-8940-e17c5a8f7403 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:41.993494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886c2ae-eb6d-467a-8940-e17c5a8f7403 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:41.999222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed8e26-54a8-4c92-92c4-bc0730a8e68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:41.999861 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed8e26-54a8-4c92-92c4-bc0730a8e68a admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:42.000161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed8e26-54a8-4c92-92c4-bc0730a8e68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:42.000429 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed8e26-54a8-4c92-92c4-bc0730a8e68a admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:42.001071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed8e26-54a8-4c92-92c4-bc0730a8e68a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:11:42.001404 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed8e26-54a8-4c92-92c4-bc0730a8e68a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:42.003001 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed8e26-54a8-4c92-92c4-bc0730a8e68a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:42.015066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 908/1815] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:11:42.025581 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025372-cd95-4557-b418-1a6e76261861 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:42.035283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025372-cd95-4557-b418-1a6e76261861 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:42.040114 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed141e5-b7f4-415c-bc2c-d89d257c548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:42.040717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed141e5-b7f4-415c-bc2c-d89d257c548e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:42.040998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed141e5-b7f4-415c-bc2c-d89d257c548e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:42.041305 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed141e5-b7f4-415c-bc2c-d89d257c548e admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:42.041954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed141e5-b7f4-415c-bc2c-d89d257c548e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:42.044592 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed141e5-b7f4-415c-bc2c-d89d257c548e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:42.129889 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 908/1816] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:11:42 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:42.133741 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed8e26-54a8-4c92-92c4-bc0730a8e68a admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:42.145418 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed8e26-54a8-4c92-92c4-bc0730a8e68a admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:42.217930 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:42.226814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e26fdc-8ab9-4768-a7e7-42801d09df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:42.227441 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e26fdc-8ab9-4768-a7e7-42801d09df5a admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:42.227715 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e26fdc-8ab9-4768-a7e7-42801d09df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:42.228016 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e26fdc-8ab9-4768-a7e7-42801d09df5a admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:42.232085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e26fdc-8ab9-4768-a7e7-42801d09df5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:42.232085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e26fdc-8ab9-4768-a7e7-42801d09df5a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:42.307928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 909/1817] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:11:42 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:42.308955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed141e5-b7f4-415c-bc2c-d89d257c548e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:42.320727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed141e5-b7f4-415c-bc2c-d89d257c548e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:42.325413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e7e64-77fe-4dfd-bace-b3e1cde26b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:42.326068 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e7e64-77fe-4dfd-bace-b3e1cde26b36 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:42.326341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e7e64-77fe-4dfd-bace-b3e1cde26b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:42.326607 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e7e64-77fe-4dfd-bace-b3e1cde26b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:42.327246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e7e64-77fe-4dfd-bace-b3e1cde26b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:42.328860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e7e64-77fe-4dfd-bace-b3e1cde26b36 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:42.339630 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 909/1818] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:11:42.344571 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e26fdc-8ab9-4768-a7e7-42801d09df5a admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:42.355184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e26fdc-8ab9-4768-a7e7-42801d09df5a admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:42.360783 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196e2f8-f06a-4b25-8536-20191d085905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:42.361472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e2f8-f06a-4b25-8536-20191d085905 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:42.361743 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e2f8-f06a-4b25-8536-20191d085905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:42.362009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e2f8-f06a-4b25-8536-20191d085905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:42.362643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196e2f8-f06a-4b25-8536-20191d085905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:42.364263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196e2f8-f06a-4b25-8536-20191d085905 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:42.376052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 910/1819] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:11:42.380496 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e7e64-77fe-4dfd-bace-b3e1cde26b36 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:42.391102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e7e64-77fe-4dfd-bace-b3e1cde26b36 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:42.395837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b98076-2ab8-4af9-976e-812fa5131ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:42.396554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b98076-2ab8-4af9-976e-812fa5131ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:42.396828 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b98076-2ab8-4af9-976e-812fa5131ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:42.397098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b98076-2ab8-4af9-976e-812fa5131ef4 admin admin] PATH_INFO: `/v3/projects/3dd903c214e2404dab7d1521d2019e97/users/07bd1ce132b04ff5b5e4b82bd010bd1a/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:42.413755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b98076-2ab8-4af9-976e-812fa5131ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd903c214e2404dab7d1521d2019e97, user_id=07bd1ce132b04ff5b5e4b82bd010bd1a, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:42.416396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b98076-2ab8-4af9-976e-812fa5131ef4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:42.510635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 910/1820] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:42 2022] PUT /identity/v3/projects/3dd903c214e2404dab7d1521d2019e97/users/07bd1ce132b04ff5b5e4b82bd010bd1a/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:42.523109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ab9d3-fdb5-42d2-8df0-784a57504d67 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:42.523383 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ab9d3-fdb5-42d2-8df0-784a57504d67 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:42.523648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ab9d3-fdb5-42d2-8df0-784a57504d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:42.554188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-8e9ab9d3-fdb5-42d2-8df0-784a57504d67 None None] MFA Rules not processed for user `07bd1ce132b04ff5b5e4b82bd010bd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:42.555614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-8e9ab9d3-fdb5-42d2-8df0-784a57504d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:42.624202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 911/1821] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:42.628707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b98076-2ab8-4af9-976e-812fa5131ef4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:42.689466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:42.712874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b98076-2ab8-4af9-976e-812fa5131ef4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:42.727519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ed469-953d-4a6a-9afc-ea3f76d5991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:42.727519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ed469-953d-4a6a-9afc-ea3f76d5991c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:42.727519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ed469-953d-4a6a-9afc-ea3f76d5991c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:42.727519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ed469-953d-4a6a-9afc-ea3f76d5991c admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:42.727907 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ed469-953d-4a6a-9afc-ea3f76d5991c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:42.727907 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ed469-953d-4a6a-9afc-ea3f76d5991c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:43.782073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 911/1822] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:11:42 2022] POST /identity/v3/projects => generated 369 bytes in 1154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:11:43.786357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ab9d3-fdb5-42d2-8df0-784a57504d67 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:43.798207 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ab9d3-fdb5-42d2-8df0-784a57504d67 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:43.858016 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4d633-c943-4909-8f97-29120d20517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:43.858631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4d633-c943-4909-8f97-29120d20517c admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:43.858906 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4d633-c943-4909-8f97-29120d20517c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:43.859176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4d633-c943-4909-8f97-29120d20517c admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:43.859815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4d633-c943-4909-8f97-29120d20517c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:43.861758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4d633-c943-4909-8f97-29120d20517c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:44.118226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 912/1823] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:11:43 2022] POST /identity/v3/users => generated 291 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:44.122063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ed469-953d-4a6a-9afc-ea3f76d5991c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:44.134804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ed469-953d-4a6a-9afc-ea3f76d5991c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:44.140611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07390bd1-ef50-40c9-9879-58ff204319b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:44.141216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07390bd1-ef50-40c9-9879-58ff204319b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:44.141524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07390bd1-ef50-40c9-9879-58ff204319b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:44.141797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07390bd1-ef50-40c9-9879-58ff204319b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:44.142498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07390bd1-ef50-40c9-9879-58ff204319b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:44.144079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07390bd1-ef50-40c9-9879-58ff204319b7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:44.161722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 912/1824] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:44.165176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4d633-c943-4909-8f97-29120d20517c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:44.187839 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4d633-c943-4909-8f97-29120d20517c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:44.196309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88695374-506f-46a1-a89a-37639653a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:44.197065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88695374-506f-46a1-a89a-37639653a92a admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:44.197429 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88695374-506f-46a1-a89a-37639653a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:44.197773 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88695374-506f-46a1-a89a-37639653a92a admin admin] PATH_INFO: `/v3/projects/58ed3c38b52b4f0186d00b6df660cff7/users/4b1affb06ce4400292ad2bba75d394d3/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:44.216230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88695374-506f-46a1-a89a-37639653a92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ed3c38b52b4f0186d00b6df660cff7, user_id=4b1affb06ce4400292ad2bba75d394d3, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:44.219150 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88695374-506f-46a1-a89a-37639653a92a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:44.287458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 913/1825] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:44 2022] PUT /identity/v3/projects/58ed3c38b52b4f0186d00b6df660cff7/users/4b1affb06ce4400292ad2bba75d394d3/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:11:44.291795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07390bd1-ef50-40c9-9879-58ff204319b7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:44.304541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07390bd1-ef50-40c9-9879-58ff204319b7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:44.375579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be217cc5-fc19-4c2d-b821-c9e6af25c60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:44.376208 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217cc5-fc19-4c2d-b821-c9e6af25c60a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:44.376489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217cc5-fc19-4c2d-b821-c9e6af25c60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:44.376766 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217cc5-fc19-4c2d-b821-c9e6af25c60a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:44.377561 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be217cc5-fc19-4c2d-b821-c9e6af25c60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:44.384711 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be217cc5-fc19-4c2d-b821-c9e6af25c60a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:44.392568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 913/1826] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:44.396957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88695374-506f-46a1-a89a-37639653a92a admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:44.408118 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88695374-506f-46a1-a89a-37639653a92a admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:44.412897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea549cec-29d8-4b01-a450-46be99a60005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:44.413593 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea549cec-29d8-4b01-a450-46be99a60005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:44.413872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea549cec-29d8-4b01-a450-46be99a60005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:44.414142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea549cec-29d8-4b01-a450-46be99a60005 admin admin] PATH_INFO: `/v3/projects/58ed3c38b52b4f0186d00b6df660cff7/users/4b1affb06ce4400292ad2bba75d394d3/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:44.416194 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea549cec-29d8-4b01-a450-46be99a60005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ed3c38b52b4f0186d00b6df660cff7, user_id=4b1affb06ce4400292ad2bba75d394d3, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:44.419612 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea549cec-29d8-4b01-a450-46be99a60005 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:44.431253 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 914/1827] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:44 2022] PUT /identity/v3/projects/58ed3c38b52b4f0186d00b6df660cff7/users/4b1affb06ce4400292ad2bba75d394d3/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:44.443129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b797-7b8a-4c31-aa18-f0cba9a58f8d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:44.443418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b797-7b8a-4c31-aa18-f0cba9a58f8d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:44.443724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116b797-7b8a-4c31-aa18-f0cba9a58f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:44.475382 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2116b797-7b8a-4c31-aa18-f0cba9a58f8d None None] MFA Rules not processed for user `4b1affb06ce4400292ad2bba75d394d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:44.477272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2116b797-7b8a-4c31-aa18-f0cba9a58f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:44.546844 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 914/1828] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:44.558064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea549cec-29d8-4b01-a450-46be99a60005 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:44.560428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ea549cec-29d8-4b01-a450-46be99a60005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:44.578347 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:44.626137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea549cec-29d8-4b01-a450-46be99a60005 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:44.629797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bed141-2c1b-4be6-86f9-4a4c893e4243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:44.630622 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bed141-2c1b-4be6-86f9-4a4c893e4243 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:44.631102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bed141-2c1b-4be6-86f9-4a4c893e4243 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:44.631592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bed141-2c1b-4be6-86f9-4a4c893e4243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:44.641536 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bed141-2c1b-4be6-86f9-4a4c893e4243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:44.642955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bed141-2c1b-4be6-86f9-4a4c893e4243 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:44.653077 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 915/1829] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:47.565776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116b797-7b8a-4c31-aa18-f0cba9a58f8d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:47.608735 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:47.630721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116b797-7b8a-4c31-aa18-f0cba9a58f8d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:47.636036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:47.636036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:47.641891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:47.641891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] PATH_INFO: `/v3/users/07bd1ce132b04ff5b5e4b82bd010bd1a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:47.641891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] RBAC: Authorizing `identity:delete_user(user_id=07bd1ce132b04ff5b5e4b82bd010bd1a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:47.641891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:47.828160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07bd1ce132b04ff5b5e4b82bd010bd1a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:47.828872 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07bd1ce132b04ff5b5e4b82bd010bd1a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:47.836912 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07bd1ce132b04ff5b5e4b82bd010bd1a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:47.910642 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07bd1ce132b04ff5b5e4b82bd010bd1a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:47.923832 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07bd1ce132b04ff5b5e4b82bd010bd1a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:47.930217 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 915/1830] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:11:47 2022] DELETE /identity/v3/users/07bd1ce132b04ff5b5e4b82bd010bd1a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:47.934905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eae0a5-81d9-45f4-939d-87c66df098b4 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:47.935425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eae0a5-81d9-45f4-939d-87c66df098b4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:47.935425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eae0a5-81d9-45f4-939d-87c66df098b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:47.958641 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-14eae0a5-81d9-45f4-939d-87c66df098b4 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:47.958641 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-14eae0a5-81d9-45f4-939d-87c66df098b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:48.039945 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 916/1831] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:48.050887 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:48.052568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:48.116132 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041ee60-5042-4ae2-a7a4-1ec59209721f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:48.122040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a811fec-1a44-4dd2-8458-511c5af0e3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:48.122756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a811fec-1a44-4dd2-8458-511c5af0e3ef service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:48.123224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a811fec-1a44-4dd2-8458-511c5af0e3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:48.123447 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a811fec-1a44-4dd2-8458-511c5af0e3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:48.134632 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a811fec-1a44-4dd2-8458-511c5af0e3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:48.138166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a811fec-1a44-4dd2-8458-511c5af0e3ef service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:48.148688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 916/1832] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:48.550398 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eae0a5-81d9-45f4-939d-87c66df098b4 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:48.552085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-14eae0a5-81d9-45f4-939d-87c66df098b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:48.565972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eae0a5-81d9-45f4-939d-87c66df098b4 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:48.570741 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:48.571457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:48.571761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:48.571903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] PATH_INFO: `/v3/projects/3dd903c214e2404dab7d1521d2019e97` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:48.573613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd903c214e2404dab7d1521d2019e97)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:48.576654 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:48.682052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd903c214e2404dab7d1521d2019e97', 'request_id': 'req-23d8132c-0016-4b04-be96-843f8825f031'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:48.755179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd903c214e2404dab7d1521d2019e97', 'request_id': 'req-23d8132c-0016-4b04-be96-843f8825f031'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:48.761774 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd903c214e2404dab7d1521d2019e97', 'request_id': 'req-23d8132c-0016-4b04-be96-843f8825f031'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:48.772409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] The token cache is being invalidate because project 3dd903c214e2404dab7d1521d2019e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:11:48.772693 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:48.773386 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:48.774884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 917/1833] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:11:48 2022] DELETE /identity/v3/projects/3dd903c214e2404dab7d1521d2019e97 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:48.779152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a811fec-1a44-4dd2-8458-511c5af0e3ef service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:48.788587 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a811fec-1a44-4dd2-8458-511c5af0e3ef service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:48.847728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bf229-0dbe-424a-86c9-ca8dcc09f0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:48.849046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bf229-0dbe-424a-86c9-ca8dcc09f0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:48.849385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bf229-0dbe-424a-86c9-ca8dcc09f0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:48.849664 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bf229-0dbe-424a-86c9-ca8dcc09f0ec admin admin] PATH_INFO: `/v3/users/4b1affb06ce4400292ad2bba75d394d3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:48.850963 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bf229-0dbe-424a-86c9-ca8dcc09f0ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1affb06ce4400292ad2bba75d394d3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:48.853544 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bf229-0dbe-424a-86c9-ca8dcc09f0ec admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:48.855242 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:49.071971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ec6bf229-0dbe-424a-86c9-ca8dcc09f0ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1affb06ce4400292ad2bba75d394d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:49.072576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ec6bf229-0dbe-424a-86c9-ca8dcc09f0ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1affb06ce4400292ad2bba75d394d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:49.080228 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ec6bf229-0dbe-424a-86c9-ca8dcc09f0ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1affb06ce4400292ad2bba75d394d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:49.206728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ec6bf229-0dbe-424a-86c9-ca8dcc09f0ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1affb06ce4400292ad2bba75d394d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:49.219871 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ec6bf229-0dbe-424a-86c9-ca8dcc09f0ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1affb06ce4400292ad2bba75d394d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:49.225845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 917/1834] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:11:48 2022] DELETE /identity/v3/users/4b1affb06ce4400292ad2bba75d394d3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:49.785853 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:49.787314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:49.806973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8132c-0016-4b04-be96-843f8825f031 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:49.841814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:49.860432 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97efdb-33bc-40c6-981c-539829611634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:49.861057 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97efdb-33bc-40c6-981c-539829611634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:49.861368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97efdb-33bc-40c6-981c-539829611634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:49.861639 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97efdb-33bc-40c6-981c-539829611634 admin admin] PATH_INFO: `/v3/projects/58ed3c38b52b4f0186d00b6df660cff7` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:49.862749 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97efdb-33bc-40c6-981c-539829611634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ed3c38b52b4f0186d00b6df660cff7)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:49.864634 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97efdb-33bc-40c6-981c-539829611634 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:50.017964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-eb97efdb-33bc-40c6-981c-539829611634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ed3c38b52b4f0186d00b6df660cff7', 'request_id': 'req-eb97efdb-33bc-40c6-981c-539829611634'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:50.109278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-eb97efdb-33bc-40c6-981c-539829611634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ed3c38b52b4f0186d00b6df660cff7', 'request_id': 'req-eb97efdb-33bc-40c6-981c-539829611634'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:50.115992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-eb97efdb-33bc-40c6-981c-539829611634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ed3c38b52b4f0186d00b6df660cff7', 'request_id': 'req-eb97efdb-33bc-40c6-981c-539829611634'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:50.126639 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-eb97efdb-33bc-40c6-981c-539829611634 admin admin] The token cache is being invalidate because project 58ed3c38b52b4f0186d00b6df660cff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:11:50.126921 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-eb97efdb-33bc-40c6-981c-539829611634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:50.127644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-eb97efdb-33bc-40c6-981c-539829611634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:11:50.129201 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 918/1835] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:11:49 2022] DELETE /identity/v3/projects/58ed3c38b52b4f0186d00b6df660cff7 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:11:50.134100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de027b2-535a-462d-bc08-cf74122e26e7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:50.134574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de027b2-535a-462d-bc08-cf74122e26e7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:50.134676 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de027b2-535a-462d-bc08-cf74122e26e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:50.155118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2de027b2-535a-462d-bc08-cf74122e26e7 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:50.156322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2de027b2-535a-462d-bc08-cf74122e26e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:50.217040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 918/1836] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:50.224916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab75a2-227e-4f01-9672-4993fa11ebad None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:50.225194 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab75a2-227e-4f01-9672-4993fa11ebad None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:50.225496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab75a2-227e-4f01-9672-4993fa11ebad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:50.246071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-81ab75a2-227e-4f01-9672-4993fa11ebad None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:50.247462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-81ab75a2-227e-4f01-9672-4993fa11ebad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:50.255465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 919/1837] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:50.259756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de027b2-535a-462d-bc08-cf74122e26e7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:50.270224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de027b2-535a-462d-bc08-cf74122e26e7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:50.274812 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeaf43-f353-430e-9b48-8939c68eda2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:50.275414 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeaf43-f353-430e-9b48-8939c68eda2c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:50.275689 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeaf43-f353-430e-9b48-8939c68eda2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:50.275954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeaf43-f353-430e-9b48-8939c68eda2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:50.276686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeaf43-f353-430e-9b48-8939c68eda2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:11:50.277000 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeaf43-f353-430e-9b48-8939c68eda2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:50.279385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeaf43-f353-430e-9b48-8939c68eda2c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:50.292797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 919/1838] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:11:50.296759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab75a2-227e-4f01-9672-4993fa11ebad None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:50.306536 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab75a2-227e-4f01-9672-4993fa11ebad None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:50.311851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e834d-36ca-42ff-9968-f2a9b66d7327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:50.312509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e834d-36ca-42ff-9968-f2a9b66d7327 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:50.312816 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e834d-36ca-42ff-9968-f2a9b66d7327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:50.313086 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e834d-36ca-42ff-9968-f2a9b66d7327 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:50.313780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e834d-36ca-42ff-9968-f2a9b66d7327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:50.315665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e834d-36ca-42ff-9968-f2a9b66d7327 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:50.466127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 920/1839] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:11:50 2022] POST /identity/v3/projects => generated 409 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:50.470510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeaf43-f353-430e-9b48-8939c68eda2c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:50.480287 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeaf43-f353-430e-9b48-8939c68eda2c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:50.535744 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23752b-f707-4a16-a8a3-2e2bf9b79796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:50.536253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23752b-f707-4a16-a8a3-2e2bf9b79796 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:50.536548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23752b-f707-4a16-a8a3-2e2bf9b79796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:50.536809 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23752b-f707-4a16-a8a3-2e2bf9b79796 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:50.537456 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23752b-f707-4a16-a8a3-2e2bf9b79796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:50.539370 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23752b-f707-4a16-a8a3-2e2bf9b79796 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:50.550785 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:50.646177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 920/1840] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:11:50 2022] POST /identity/v3/users => generated 305 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:50.647364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e834d-36ca-42ff-9968-f2a9b66d7327 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:50.658652 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e834d-36ca-42ff-9968-f2a9b66d7327 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:50.663333 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70d330-59eb-4211-9e4d-56dc711ec441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:50.663927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70d330-59eb-4211-9e4d-56dc711ec441 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:50.664200 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70d330-59eb-4211-9e4d-56dc711ec441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:50.664468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70d330-59eb-4211-9e4d-56dc711ec441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:50.665107 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70d330-59eb-4211-9e4d-56dc711ec441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:50.666712 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70d330-59eb-4211-9e4d-56dc711ec441 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:50.680894 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 921/1841] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:50.682076 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23752b-f707-4a16-a8a3-2e2bf9b79796 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:50.692518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23752b-f707-4a16-a8a3-2e2bf9b79796 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:50.697213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887fbd87-5b98-440b-8c7f-6738078abc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:50.697842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fbd87-5b98-440b-8c7f-6738078abc74 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:50.698170 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fbd87-5b98-440b-8c7f-6738078abc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:50.698444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fbd87-5b98-440b-8c7f-6738078abc74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:50.699081 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fbd87-5b98-440b-8c7f-6738078abc74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:50.701433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887fbd87-5b98-440b-8c7f-6738078abc74 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:50.713732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 921/1842] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:11:50.718468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70d330-59eb-4211-9e4d-56dc711ec441 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:50.728504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70d330-59eb-4211-9e4d-56dc711ec441 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:50.733154 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444442-6586-4298-9f73-00be1601a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:50.733829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444442-6586-4298-9f73-00be1601a43f admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:50.734108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444442-6586-4298-9f73-00be1601a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:50.734378 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444442-6586-4298-9f73-00be1601a43f admin admin] PATH_INFO: `/v3/projects/536c54cf056d464f909a7911d946aa69/users/400a06446785408389974082368913f2/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:50.748785 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14444442-6586-4298-9f73-00be1601a43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=536c54cf056d464f909a7911d946aa69, user_id=400a06446785408389974082368913f2, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:50.751440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14444442-6586-4298-9f73-00be1601a43f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:50.841732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 922/1843] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:50 2022] PUT /identity/v3/projects/536c54cf056d464f909a7911d946aa69/users/400a06446785408389974082368913f2/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:50.852006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ba781-dec7-4a9c-a0d4-093a71fc8170 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:50.852287 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ba781-dec7-4a9c-a0d4-093a71fc8170 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:50.852559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ba781-dec7-4a9c-a0d4-093a71fc8170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:50.881398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6e4ba781-dec7-4a9c-a0d4-093a71fc8170 None None] MFA Rules not processed for user `400a06446785408389974082368913f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:50.882591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6e4ba781-dec7-4a9c-a0d4-093a71fc8170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:50.945113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 922/1844] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:50 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:50.950147 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444442-6586-4298-9f73-00be1601a43f admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:51.014391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444442-6586-4298-9f73-00be1601a43f admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:51.019960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29637686-cd91-4231-88b0-860191bf7921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:51.019960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29637686-cd91-4231-88b0-860191bf7921 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:51.020185 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29637686-cd91-4231-88b0-860191bf7921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:51.020304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29637686-cd91-4231-88b0-860191bf7921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:51.020946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29637686-cd91-4231-88b0-860191bf7921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:51.022926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29637686-cd91-4231-88b0-860191bf7921 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:51.035308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:51.129476 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 923/1845] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:11:50 2022] POST /identity/v3/projects => generated 409 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:11:51.129582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ba781-dec7-4a9c-a0d4-093a71fc8170 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:51.131125 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ba781-dec7-4a9c-a0d4-093a71fc8170 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:51.188727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10899f3-87db-4f53-9d3b-03663f7134ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:51.189567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10899f3-87db-4f53-9d3b-03663f7134ba admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:51.189784 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10899f3-87db-4f53-9d3b-03663f7134ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:51.190059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10899f3-87db-4f53-9d3b-03663f7134ba admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:51.190691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10899f3-87db-4f53-9d3b-03663f7134ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:51.192653 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10899f3-87db-4f53-9d3b-03663f7134ba admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:51.292953 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 923/1846] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:11:51 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:11:51.297070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29637686-cd91-4231-88b0-860191bf7921 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:51.307784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29637686-cd91-4231-88b0-860191bf7921 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:51.312908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7db402-b7fc-4ad4-82de-8d8653266914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:51.313531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7db402-b7fc-4ad4-82de-8d8653266914 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:51.313810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7db402-b7fc-4ad4-82de-8d8653266914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:51.318644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7db402-b7fc-4ad4-82de-8d8653266914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:51.318644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7db402-b7fc-4ad4-82de-8d8653266914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:51.318644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7db402-b7fc-4ad4-82de-8d8653266914 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:51.330434 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 924/1847] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:11:51.331537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10899f3-87db-4f53-9d3b-03663f7134ba admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:51.341954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10899f3-87db-4f53-9d3b-03663f7134ba admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:51.346719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53037e14-a70c-485c-b644-bcc3f352a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:51.347420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53037e14-a70c-485c-b644-bcc3f352a059 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:51.347697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53037e14-a70c-485c-b644-bcc3f352a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:51.347966 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53037e14-a70c-485c-b644-bcc3f352a059 admin admin] PATH_INFO: `/v3/projects/cd8bb5416d544327bfa5f85c8de56cf2/users/78b2674196fc42d7b0a29956b756cd64/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:51.363623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53037e14-a70c-485c-b644-bcc3f352a059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8bb5416d544327bfa5f85c8de56cf2, user_id=78b2674196fc42d7b0a29956b756cd64, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:51.366289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53037e14-a70c-485c-b644-bcc3f352a059 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:51.494301 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 924/1848] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:51 2022] PUT /identity/v3/projects/cd8bb5416d544327bfa5f85c8de56cf2/users/78b2674196fc42d7b0a29956b756cd64/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:11:51.498986 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7db402-b7fc-4ad4-82de-8d8653266914 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:51.510938 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7db402-b7fc-4ad4-82de-8d8653266914 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:51.582979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7213cd-d81b-4e32-9fe9-659f0ec5a88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:51.583679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7213cd-d81b-4e32-9fe9-659f0ec5a88f admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:51.584019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7213cd-d81b-4e32-9fe9-659f0ec5a88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:51.584464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7213cd-d81b-4e32-9fe9-659f0ec5a88f admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:51.585129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7213cd-d81b-4e32-9fe9-659f0ec5a88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:51.586869 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7213cd-d81b-4e32-9fe9-659f0ec5a88f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:51.602207 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 925/1849] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:11:51.602947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53037e14-a70c-485c-b644-bcc3f352a059 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:51.613998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53037e14-a70c-485c-b644-bcc3f352a059 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:51.618807 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa89e5-a7a2-4448-b539-b2b5f64f7722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:51.619493 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa89e5-a7a2-4448-b539-b2b5f64f7722 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:51.619772 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa89e5-a7a2-4448-b539-b2b5f64f7722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:51.620060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa89e5-a7a2-4448-b539-b2b5f64f7722 admin admin] PATH_INFO: `/v3/projects/cd8bb5416d544327bfa5f85c8de56cf2/users/78b2674196fc42d7b0a29956b756cd64/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:51.622301 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa89e5-a7a2-4448-b539-b2b5f64f7722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8bb5416d544327bfa5f85c8de56cf2, user_id=78b2674196fc42d7b0a29956b756cd64, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:51.624845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa89e5-a7a2-4448-b539-b2b5f64f7722 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:51.635737 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 925/1850] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:11:51 2022] PUT /identity/v3/projects/cd8bb5416d544327bfa5f85c8de56cf2/users/78b2674196fc42d7b0a29956b756cd64/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:11:51.650430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d459ef-8678-4c21-a430-da5b99c7faf9 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:51.650713 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d459ef-8678-4c21-a430-da5b99c7faf9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:51.650988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d459ef-8678-4c21-a430-da5b99c7faf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:51.682863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-14d459ef-8678-4c21-a430-da5b99c7faf9 None None] MFA Rules not processed for user `78b2674196fc42d7b0a29956b756cd64`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:11:51.684279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-14d459ef-8678-4c21-a430-da5b99c7faf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:51.762384 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 926/1851] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:11:51 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:11:51.773503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa89e5-a7a2-4448-b539-b2b5f64f7722 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:51.775223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-53fa89e5-a7a2-4448-b539-b2b5f64f7722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:11:51.807599 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:51.836495 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa89e5-a7a2-4448-b539-b2b5f64f7722 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:51.840466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d5027-18f0-4157-bfa8-b9a1aef812f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:51.841066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d5027-18f0-4157-bfa8-b9a1aef812f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:51.841382 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d5027-18f0-4157-bfa8-b9a1aef812f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:51.841642 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d5027-18f0-4157-bfa8-b9a1aef812f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:51.851064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d5027-18f0-4157-bfa8-b9a1aef812f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:51.852568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d5027-18f0-4157-bfa8-b9a1aef812f4 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:51.862630 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 926/1852] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:51 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:11:52.293401 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d459ef-8678-4c21-a430-da5b99c7faf9 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:11:52.303385 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d459ef-8678-4c21-a430-da5b99c7faf9 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:11:52.308068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c2c9d-063a-4580-85ec-5c614175a885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:11:52.308623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c2c9d-063a-4580-85ec-5c614175a885 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:11:52.309219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c2c9d-063a-4580-85ec-5c614175a885 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:11:52.309529 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c2c9d-063a-4580-85ec-5c614175a885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:11:52.376885 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c2c9d-063a-4580-85ec-5c614175a885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:11:52.378664 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c2c9d-063a-4580-85ec-5c614175a885 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:11:52.384553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:11:52.390990 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 927/1853] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:11:52 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:00.418133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d5027-18f0-4157-bfa8-b9a1aef812f4 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:00.485281 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d5027-18f0-4157-bfa8-b9a1aef812f4 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:00.489833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:00.490479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:00.490754 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:00.491031 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] PATH_INFO: `/v3/users/400a06446785408389974082368913f2` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:00.492156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] RBAC: Authorizing `identity:delete_user(user_id=400a06446785408389974082368913f2)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:00.494107 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:00.701632 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400a06446785408389974082368913f2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:00.702334 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400a06446785408389974082368913f2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:00.709982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400a06446785408389974082368913f2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:00.817905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400a06446785408389974082368913f2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:00.830636 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400a06446785408389974082368913f2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:00.836578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 927/1854] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:12:00 2022] DELETE /identity/v3/users/400a06446785408389974082368913f2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:12:00.841865 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9c659-3747-4cf2-b6d7-47b82d9dda8f None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:00.842360 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9c659-3747-4cf2-b6d7-47b82d9dda8f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:00.842656 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9c659-3747-4cf2-b6d7-47b82d9dda8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:00.863489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-92c9c659-3747-4cf2-b6d7-47b82d9dda8f None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:00.864712 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-92c9c659-3747-4cf2-b6d7-47b82d9dda8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:00.926110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 928/1855] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:12:00.936568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:00.938012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:01.012227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:01.016467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35e493-6db2-4740-a572-21388bc1a09c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:01.020019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35966078-0fd6-404d-b390-3ce05bf789a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:01.020621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966078-0fd6-404d-b390-3ce05bf789a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:01.023424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966078-0fd6-404d-b390-3ce05bf789a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:01.023424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966078-0fd6-404d-b390-3ce05bf789a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:01.031387 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35966078-0fd6-404d-b390-3ce05bf789a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:01.032813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35966078-0fd6-404d-b390-3ce05bf789a5 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:01.043597 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 928/1856] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:01.459469 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9c659-3747-4cf2-b6d7-47b82d9dda8f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:01.463258 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-92c9c659-3747-4cf2-b6d7-47b82d9dda8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:01.475335 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9c659-3747-4cf2-b6d7-47b82d9dda8f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:01.480074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:01.482550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:01.482550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:01.482550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] PATH_INFO: `/v3/projects/536c54cf056d464f909a7911d946aa69` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:01.482550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=536c54cf056d464f909a7911d946aa69)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:01.484351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:01.566871 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536c54cf056d464f909a7911d946aa69', 'request_id': 'req-48889b86-1d9b-46ce-9572-2d79a06b7af8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:01.611750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536c54cf056d464f909a7911d946aa69', 'request_id': 'req-48889b86-1d9b-46ce-9572-2d79a06b7af8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:01.618354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536c54cf056d464f909a7911d946aa69', 'request_id': 'req-48889b86-1d9b-46ce-9572-2d79a06b7af8'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:01.629788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] The token cache is being invalidate because project 536c54cf056d464f909a7911d946aa69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:12:01.630071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:01.630694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:01.632154 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 929/1857] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:12:01 2022] DELETE /identity/v3/projects/536c54cf056d464f909a7911d946aa69 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:12:01.636169 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35966078-0fd6-404d-b390-3ce05bf789a5 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:01.646581 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35966078-0fd6-404d-b390-3ce05bf789a5 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:01.701671 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907fce4-c7a9-4d19-ba4d-069eb9b8d5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:01.702341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907fce4-c7a9-4d19-ba4d-069eb9b8d5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:01.702669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907fce4-c7a9-4d19-ba4d-069eb9b8d5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:01.702848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907fce4-c7a9-4d19-ba4d-069eb9b8d5cc admin admin] PATH_INFO: `/v3/users/78b2674196fc42d7b0a29956b756cd64` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:01.703954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907fce4-c7a9-4d19-ba4d-069eb9b8d5cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b2674196fc42d7b0a29956b756cd64)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:01.705887 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907fce4-c7a9-4d19-ba4d-069eb9b8d5cc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:01.877220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4907fce4-c7a9-4d19-ba4d-069eb9b8d5cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b2674196fc42d7b0a29956b756cd64'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:01.877888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4907fce4-c7a9-4d19-ba4d-069eb9b8d5cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b2674196fc42d7b0a29956b756cd64'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:01.884892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4907fce4-c7a9-4d19-ba4d-069eb9b8d5cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b2674196fc42d7b0a29956b756cd64'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:01.960782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4907fce4-c7a9-4d19-ba4d-069eb9b8d5cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b2674196fc42d7b0a29956b756cd64'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:01.977042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4907fce4-c7a9-4d19-ba4d-069eb9b8d5cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b2674196fc42d7b0a29956b756cd64'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:01.984398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 929/1858] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:12:01 2022] DELETE /identity/v3/users/78b2674196fc42d7b0a29956b756cd64 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:12:02.609614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:02.611139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:02.624230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48889b86-1d9b-46ce-9572-2d79a06b7af8 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:02.690374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4d57b-d0d1-480a-b5b5-517304dad2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:02.691011 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4d57b-d0d1-480a-b5b5-517304dad2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:02.691283 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4d57b-d0d1-480a-b5b5-517304dad2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:02.691560 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4d57b-d0d1-480a-b5b5-517304dad2e9 admin admin] PATH_INFO: `/v3/projects/cd8bb5416d544327bfa5f85c8de56cf2` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:02.692811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4d57b-d0d1-480a-b5b5-517304dad2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8bb5416d544327bfa5f85c8de56cf2)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:02.694770 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4d57b-d0d1-480a-b5b5-517304dad2e9 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:02.808539 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:02.826291 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-44c4d57b-d0d1-480a-b5b5-517304dad2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8bb5416d544327bfa5f85c8de56cf2', 'request_id': 'req-44c4d57b-d0d1-480a-b5b5-517304dad2e9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:02.926751 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-44c4d57b-d0d1-480a-b5b5-517304dad2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8bb5416d544327bfa5f85c8de56cf2', 'request_id': 'req-44c4d57b-d0d1-480a-b5b5-517304dad2e9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:02.934191 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-44c4d57b-d0d1-480a-b5b5-517304dad2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8bb5416d544327bfa5f85c8de56cf2', 'request_id': 'req-44c4d57b-d0d1-480a-b5b5-517304dad2e9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:02.945364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-44c4d57b-d0d1-480a-b5b5-517304dad2e9 admin admin] The token cache is being invalidate because project cd8bb5416d544327bfa5f85c8de56cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:12:02.945656 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-44c4d57b-d0d1-480a-b5b5-517304dad2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:02.946310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-44c4d57b-d0d1-480a-b5b5-517304dad2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:02.947884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 930/1859] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:12:02 2022] DELETE /identity/v3/projects/cd8bb5416d544327bfa5f85c8de56cf2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:12:02.953167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611efb1-cf09-4712-9fac-2d71618889ca None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:02.953862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611efb1-cf09-4712-9fac-2d71618889ca None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:02.953862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611efb1-cf09-4712-9fac-2d71618889ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:02.976854 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a611efb1-cf09-4712-9fac-2d71618889ca None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:02.978373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a611efb1-cf09-4712-9fac-2d71618889ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:03.042079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 930/1860] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:03.051267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6b0f-ee31-47d1-84a1-19c51b4e61d9 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:03.051823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6b0f-ee31-47d1-84a1-19c51b4e61d9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:03.052090 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6b0f-ee31-47d1-84a1-19c51b4e61d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:03.072567 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-640f6b0f-ee31-47d1-84a1-19c51b4e61d9 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:03.073818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-640f6b0f-ee31-47d1-84a1-19c51b4e61d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:03.082551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 931/1861] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:03.086722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611efb1-cf09-4712-9fac-2d71618889ca None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:03.096537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611efb1-cf09-4712-9fac-2d71618889ca None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:03.101089 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152772c-954d-480d-bd02-86716c414ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:03.101717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152772c-954d-480d-bd02-86716c414ebb admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:03.101997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152772c-954d-480d-bd02-86716c414ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:03.102265 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152772c-954d-480d-bd02-86716c414ebb admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:03.102910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152772c-954d-480d-bd02-86716c414ebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:12:03.103248 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152772c-954d-480d-bd02-86716c414ebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:03.104855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152772c-954d-480d-bd02-86716c414ebb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:03.111958 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:03.120662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 931/1862] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:12:03.121775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6b0f-ee31-47d1-84a1-19c51b4e61d9 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:03.172166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6b0f-ee31-47d1-84a1-19c51b4e61d9 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:03.172166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe0db0-aefc-48f7-9f39-ed69f9c0d35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:03.172166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe0db0-aefc-48f7-9f39-ed69f9c0d35b admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:03.172166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe0db0-aefc-48f7-9f39-ed69f9c0d35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:03.172938 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe0db0-aefc-48f7-9f39-ed69f9c0d35b admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:03.172938 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe0db0-aefc-48f7-9f39-ed69f9c0d35b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:03.172938 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe0db0-aefc-48f7-9f39-ed69f9c0d35b admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:03.301042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 932/1863] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:12:03 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:12:03.304509 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152772c-954d-480d-bd02-86716c414ebb admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:03.315040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152772c-954d-480d-bd02-86716c414ebb admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:03.372881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25f5c5-ef34-49b4-b888-a5e27a4d2bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:03.374036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25f5c5-ef34-49b4-b888-a5e27a4d2bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:03.374315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25f5c5-ef34-49b4-b888-a5e27a4d2bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:03.374590 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25f5c5-ef34-49b4-b888-a5e27a4d2bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:03.375223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25f5c5-ef34-49b4-b888-a5e27a4d2bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:03.377142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25f5c5-ef34-49b4-b888-a5e27a4d2bf0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:03.463033 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 932/1864] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:12:03 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:12:03.467253 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe0db0-aefc-48f7-9f39-ed69f9c0d35b admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:03.477686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe0db0-aefc-48f7-9f39-ed69f9c0d35b admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:03.483006 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0c854-05fc-4298-82c8-9005689cc7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:03.483608 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0c854-05fc-4298-82c8-9005689cc7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:03.483887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0c854-05fc-4298-82c8-9005689cc7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:03.484158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0c854-05fc-4298-82c8-9005689cc7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:03.484805 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0c854-05fc-4298-82c8-9005689cc7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:03.486428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0c854-05fc-4298-82c8-9005689cc7f9 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:03.496886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 933/1865] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:12:03.502790 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25f5c5-ef34-49b4-b888-a5e27a4d2bf0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:03.512861 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25f5c5-ef34-49b4-b888-a5e27a4d2bf0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:03.526075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2312ccc-9a60-4bdb-a464-7c872daeb368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:03.526691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2312ccc-9a60-4bdb-a464-7c872daeb368 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:03.527172 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2312ccc-9a60-4bdb-a464-7c872daeb368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:03.527394 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2312ccc-9a60-4bdb-a464-7c872daeb368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:03.527856 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2312ccc-9a60-4bdb-a464-7c872daeb368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:03.529611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2312ccc-9a60-4bdb-a464-7c872daeb368 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:03.540903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 933/1866] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:12:03.545451 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0c854-05fc-4298-82c8-9005689cc7f9 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:03.559040 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0c854-05fc-4298-82c8-9005689cc7f9 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:03.571194 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd168c-35b6-4a86-aac3-a3496a36e015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:03.573499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd168c-35b6-4a86-aac3-a3496a36e015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:03.573499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd168c-35b6-4a86-aac3-a3496a36e015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:03.573499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd168c-35b6-4a86-aac3-a3496a36e015 admin admin] PATH_INFO: `/v3/projects/1b6f97b2f7f747e197dc83a164490808/users/6f54e9ab57784c7e9b9a341d653c17e8/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:03.589045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd168c-35b6-4a86-aac3-a3496a36e015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6f97b2f7f747e197dc83a164490808, user_id=6f54e9ab57784c7e9b9a341d653c17e8, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:03.591785 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd168c-35b6-4a86-aac3-a3496a36e015 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:03.641982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 934/1867] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:12:03 2022] PUT /identity/v3/projects/1b6f97b2f7f747e197dc83a164490808/users/6f54e9ab57784c7e9b9a341d653c17e8/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:12:03.652441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565be8ac-e7f3-4d09-b3da-74739e3b62fd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:03.652847 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565be8ac-e7f3-4d09-b3da-74739e3b62fd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:03.653130 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565be8ac-e7f3-4d09-b3da-74739e3b62fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:03.690744 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-565be8ac-e7f3-4d09-b3da-74739e3b62fd None None] MFA Rules not processed for user `6f54e9ab57784c7e9b9a341d653c17e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:03.692036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-565be8ac-e7f3-4d09-b3da-74739e3b62fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:03.766517 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 934/1868] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:12:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:03.768349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd168c-35b6-4a86-aac3-a3496a36e015 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:03.833731 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd168c-35b6-4a86-aac3-a3496a36e015 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:03.847031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6266a2-051c-486a-bc89-59e84f986c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:03.847031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6266a2-051c-486a-bc89-59e84f986c95 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:03.847031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6266a2-051c-486a-bc89-59e84f986c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:03.847031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6266a2-051c-486a-bc89-59e84f986c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:03.847595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6266a2-051c-486a-bc89-59e84f986c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:03.847595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6266a2-051c-486a-bc89-59e84f986c95 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:03.976371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 935/1869] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:12:03 2022] POST /identity/v3/projects => generated 367 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:12:03.980194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565be8ac-e7f3-4d09-b3da-74739e3b62fd None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:03.991599 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565be8ac-e7f3-4d09-b3da-74739e3b62fd None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:04.050633 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a994080-a99d-4a31-8a1d-0e9caa1a96de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:04.051246 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a994080-a99d-4a31-8a1d-0e9caa1a96de admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:04.051884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a994080-a99d-4a31-8a1d-0e9caa1a96de admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:04.052242 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a994080-a99d-4a31-8a1d-0e9caa1a96de admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:04.052788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a994080-a99d-4a31-8a1d-0e9caa1a96de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:04.054728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a994080-a99d-4a31-8a1d-0e9caa1a96de admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:04.066268 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:04.156407 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 935/1870] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:12:03 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:12:04.160357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6266a2-051c-486a-bc89-59e84f986c95 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:04.170897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6266a2-051c-486a-bc89-59e84f986c95 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:04.175696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b279a-644a-420c-b792-52434a56288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:04.176322 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b279a-644a-420c-b792-52434a56288f admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:04.176895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b279a-644a-420c-b792-52434a56288f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:04.177166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b279a-644a-420c-b792-52434a56288f admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:04.177861 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b279a-644a-420c-b792-52434a56288f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:04.179453 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b279a-644a-420c-b792-52434a56288f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:04.190949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 936/1871] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:12:04.195196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a994080-a99d-4a31-8a1d-0e9caa1a96de admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:04.205691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a994080-a99d-4a31-8a1d-0e9caa1a96de admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:04.210180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b00d8-6478-4cfa-9d8c-8d6d8571a118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:04.210837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b00d8-6478-4cfa-9d8c-8d6d8571a118 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:04.211352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b00d8-6478-4cfa-9d8c-8d6d8571a118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:04.211842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b00d8-6478-4cfa-9d8c-8d6d8571a118 admin admin] PATH_INFO: `/v3/projects/841d01e964364ef3818ee8e2b8249c5b/users/a11baf0dcde74c499dded3d9555d6635/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:04.227621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b00d8-6478-4cfa-9d8c-8d6d8571a118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=841d01e964364ef3818ee8e2b8249c5b, user_id=a11baf0dcde74c499dded3d9555d6635, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:04.230285 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b00d8-6478-4cfa-9d8c-8d6d8571a118 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:04.304074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 936/1872] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:12:04 2022] PUT /identity/v3/projects/841d01e964364ef3818ee8e2b8249c5b/users/a11baf0dcde74c499dded3d9555d6635/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:12:04.308108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b279a-644a-420c-b792-52434a56288f admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:04.318492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b279a-644a-420c-b792-52434a56288f admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:04.339118 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:04.376267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec1b83-7e31-4d58-85a4-8c082a4ac670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:04.376864 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec1b83-7e31-4d58-85a4-8c082a4ac670 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:04.377137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec1b83-7e31-4d58-85a4-8c082a4ac670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:04.377438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec1b83-7e31-4d58-85a4-8c082a4ac670 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:04.378068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec1b83-7e31-4d58-85a4-8c082a4ac670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:04.379648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec1b83-7e31-4d58-85a4-8c082a4ac670 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:04.389591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 937/1873] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:12:04.393715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b00d8-6478-4cfa-9d8c-8d6d8571a118 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:04.404508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b00d8-6478-4cfa-9d8c-8d6d8571a118 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:04.409211 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee817fa4-e9f2-42b5-9641-2e8fe9b04cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:04.409890 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee817fa4-e9f2-42b5-9641-2e8fe9b04cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:04.410161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee817fa4-e9f2-42b5-9641-2e8fe9b04cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:04.410488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee817fa4-e9f2-42b5-9641-2e8fe9b04cd8 admin admin] PATH_INFO: `/v3/projects/841d01e964364ef3818ee8e2b8249c5b/users/a11baf0dcde74c499dded3d9555d6635/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:04.412363 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee817fa4-e9f2-42b5-9641-2e8fe9b04cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=841d01e964364ef3818ee8e2b8249c5b, user_id=a11baf0dcde74c499dded3d9555d6635, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:04.415060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee817fa4-e9f2-42b5-9641-2e8fe9b04cd8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:04.426030 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 937/1874] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:12:04 2022] PUT /identity/v3/projects/841d01e964364ef3818ee8e2b8249c5b/users/a11baf0dcde74c499dded3d9555d6635/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:12:04.436589 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecc69f-1fe2-4354-a601-c52068246db8 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:04.436880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecc69f-1fe2-4354-a601-c52068246db8 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:04.437154 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecc69f-1fe2-4354-a601-c52068246db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:04.465758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-81ecc69f-1fe2-4354-a601-c52068246db8 None None] MFA Rules not processed for user `a11baf0dcde74c499dded3d9555d6635`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:04.467842 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-81ecc69f-1fe2-4354-a601-c52068246db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:04.535783 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 938/1875] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:12:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:04.547654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee817fa4-e9f2-42b5-9641-2e8fe9b04cd8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:04.549557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ee817fa4-e9f2-42b5-9641-2e8fe9b04cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:04.610280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee817fa4-e9f2-42b5-9641-2e8fe9b04cd8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:04.613973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79f3bc-73cf-4e3c-b904-841d16befd99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:04.614616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f3bc-73cf-4e3c-b904-841d16befd99 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:04.614895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f3bc-73cf-4e3c-b904-841d16befd99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:04.615168 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79f3bc-73cf-4e3c-b904-841d16befd99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:04.625079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79f3bc-73cf-4e3c-b904-841d16befd99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:04.626558 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79f3bc-73cf-4e3c-b904-841d16befd99 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:04.639112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 938/1876] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:04.965759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecc69f-1fe2-4354-a601-c52068246db8 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:04.965759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-81ecc69f-1fe2-4354-a601-c52068246db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:04.986559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecc69f-1fe2-4354-a601-c52068246db8 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:04.990686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0088d2-83a6-4f1d-afc3-9b6b4b5308af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:04.991317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0088d2-83a6-4f1d-afc3-9b6b4b5308af service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:04.991597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0088d2-83a6-4f1d-afc3-9b6b4b5308af service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:04.991867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0088d2-83a6-4f1d-afc3-9b6b4b5308af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:05.073115 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0088d2-83a6-4f1d-afc3-9b6b4b5308af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:05.074733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0088d2-83a6-4f1d-afc3-9b6b4b5308af service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:05.085885 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 939/1877] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:10.152637 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79f3bc-73cf-4e3c-b904-841d16befd99 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:10.154980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6f79f3bc-73cf-4e3c-b904-841d16befd99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:10.246588 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79f3bc-73cf-4e3c-b904-841d16befd99 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:10.256037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e06a5-6d4f-43d7-ae8e-daf27e391c74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:10.261019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e06a5-6d4f-43d7-ae8e-daf27e391c74 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:10.261667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e06a5-6d4f-43d7-ae8e-daf27e391c74 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:10.262004 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e06a5-6d4f-43d7-ae8e-daf27e391c74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:10.264068 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-031e06a5-6d4f-43d7-ae8e-daf27e391c74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:10.277881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e06a5-6d4f-43d7-ae8e-daf27e391c74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:10.280638 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e06a5-6d4f-43d7-ae8e-daf27e391c74 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:10.305442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 939/1878] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:11.737028 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0088d2-83a6-4f1d-afc3-9b6b4b5308af service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:11.739433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0b0088d2-83a6-4f1d-afc3-9b6b4b5308af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:11.797635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:11.808199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0088d2-83a6-4f1d-afc3-9b6b4b5308af service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:11.812121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56f7b-5df6-432b-953a-4dabd2dbde14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:11.812720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56f7b-5df6-432b-953a-4dabd2dbde14 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:11.812991 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56f7b-5df6-432b-953a-4dabd2dbde14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:11.813249 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56f7b-5df6-432b-953a-4dabd2dbde14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:11.815028 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9ee56f7b-5df6-432b-953a-4dabd2dbde14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:11.901784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56f7b-5df6-432b-953a-4dabd2dbde14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:11.901784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56f7b-5df6-432b-953a-4dabd2dbde14 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:11.911599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 940/1879] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:13.729760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e06a5-6d4f-43d7-ae8e-daf27e391c74 service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:13.784162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:13.796094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e06a5-6d4f-43d7-ae8e-daf27e391c74 service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:13.801239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:13.802298 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:13.802564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:13.802909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] PATH_INFO: `/v3/users/6f54e9ab57784c7e9b9a341d653c17e8` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:13.804129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f54e9ab57784c7e9b9a341d653c17e8)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:13.806141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:14.064085 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f54e9ab57784c7e9b9a341d653c17e8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:14.064747 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f54e9ab57784c7e9b9a341d653c17e8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:14.076072 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f54e9ab57784c7e9b9a341d653c17e8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:14.190104 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f54e9ab57784c7e9b9a341d653c17e8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:14.204277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f54e9ab57784c7e9b9a341d653c17e8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:14.212360 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 940/1880] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:12:13 2022] DELETE /identity/v3/users/6f54e9ab57784c7e9b9a341d653c17e8 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:12:14.217077 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b57986-3e70-4ec9-bc54-1c7ed6e468a8 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:14.217579 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b57986-3e70-4ec9-bc54-1c7ed6e468a8 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:14.217579 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b57986-3e70-4ec9-bc54-1c7ed6e468a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:14.240011 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d7b57986-3e70-4ec9-bc54-1c7ed6e468a8 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:14.241372 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d7b57986-3e70-4ec9-bc54-1c7ed6e468a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:14.322413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 941/1881] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:14.332721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:14.334263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:14.415438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f959c-89ef-48ac-a313-e05ee745ab0e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:14.424504 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd143e7-e391-460c-96ed-be0e9c088b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:14.425342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd143e7-e391-460c-96ed-be0e9c088b30 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:14.425718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd143e7-e391-460c-96ed-be0e9c088b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:14.426105 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd143e7-e391-460c-96ed-be0e9c088b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:14.436824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd143e7-e391-460c-96ed-be0e9c088b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:14.438503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd143e7-e391-460c-96ed-be0e9c088b30 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:14.449350 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 941/1882] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:12:15.268946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b57986-3e70-4ec9-bc54-1c7ed6e468a8 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:15.270615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d7b57986-3e70-4ec9-bc54-1c7ed6e468a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:15.284591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b57986-3e70-4ec9-bc54-1c7ed6e468a8 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:15.301826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:15.303412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:15.303893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:15.304359 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] PATH_INFO: `/v3/projects/1b6f97b2f7f747e197dc83a164490808` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:15.306742 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6f97b2f7f747e197dc83a164490808)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:15.308895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:15.462223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6f97b2f7f747e197dc83a164490808', 'request_id': 'req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:15.607615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6f97b2f7f747e197dc83a164490808', 'request_id': 'req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:15.615541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6f97b2f7f747e197dc83a164490808', 'request_id': 'req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:15.634646 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] The token cache is being invalidate because project 1b6f97b2f7f747e197dc83a164490808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:12:15.635205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:15.636078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:15.637945 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 942/1883] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:12:15 2022] DELETE /identity/v3/projects/1b6f97b2f7f747e197dc83a164490808 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:12:15.642112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd143e7-e391-460c-96ed-be0e9c088b30 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:15.653599 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd143e7-e391-460c-96ed-be0e9c088b30 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:15.725375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939bedd-011f-4210-876a-627e8af4121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:15.726189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939bedd-011f-4210-876a-627e8af4121d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:15.726590 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939bedd-011f-4210-876a-627e8af4121d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:15.726872 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939bedd-011f-4210-876a-627e8af4121d admin admin] PATH_INFO: `/v3/users/a11baf0dcde74c499dded3d9555d6635` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:15.728054 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939bedd-011f-4210-876a-627e8af4121d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a11baf0dcde74c499dded3d9555d6635)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:15.730016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939bedd-011f-4210-876a-627e8af4121d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:15.745686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:15.994305 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b939bedd-011f-4210-876a-627e8af4121d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a11baf0dcde74c499dded3d9555d6635'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:15.995074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b939bedd-011f-4210-876a-627e8af4121d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a11baf0dcde74c499dded3d9555d6635'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:16.003530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b939bedd-011f-4210-876a-627e8af4121d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a11baf0dcde74c499dded3d9555d6635'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:16.075082 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b939bedd-011f-4210-876a-627e8af4121d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a11baf0dcde74c499dded3d9555d6635'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:16.097909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b939bedd-011f-4210-876a-627e8af4121d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a11baf0dcde74c499dded3d9555d6635'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:16.104652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 942/1884] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:12:15 2022] DELETE /identity/v3/users/a11baf0dcde74c499dded3d9555d6635 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:12:16.632079 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:16.636877 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:16.655504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e7150-8e43-4e4f-bca3-0c9f0f1aabd1 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:16.671416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:16.731972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c11b9-3fcb-435e-a953-c49e9f63f498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:16.732796 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c11b9-3fcb-435e-a953-c49e9f63f498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:16.733167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c11b9-3fcb-435e-a953-c49e9f63f498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:16.733577 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c11b9-3fcb-435e-a953-c49e9f63f498 admin admin] PATH_INFO: `/v3/projects/841d01e964364ef3818ee8e2b8249c5b` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:16.734870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c11b9-3fcb-435e-a953-c49e9f63f498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=841d01e964364ef3818ee8e2b8249c5b)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:16.736939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c11b9-3fcb-435e-a953-c49e9f63f498 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:16.904858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-139c11b9-3fcb-435e-a953-c49e9f63f498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841d01e964364ef3818ee8e2b8249c5b', 'request_id': 'req-139c11b9-3fcb-435e-a953-c49e9f63f498'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:17.018358 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-139c11b9-3fcb-435e-a953-c49e9f63f498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841d01e964364ef3818ee8e2b8249c5b', 'request_id': 'req-139c11b9-3fcb-435e-a953-c49e9f63f498'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:17.025385 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-139c11b9-3fcb-435e-a953-c49e9f63f498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841d01e964364ef3818ee8e2b8249c5b', 'request_id': 'req-139c11b9-3fcb-435e-a953-c49e9f63f498'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:17.036163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-139c11b9-3fcb-435e-a953-c49e9f63f498 admin admin] The token cache is being invalidate because project 841d01e964364ef3818ee8e2b8249c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:12:17.036447 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-139c11b9-3fcb-435e-a953-c49e9f63f498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:17.037087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-139c11b9-3fcb-435e-a953-c49e9f63f498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:12:17.038784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 943/1885] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:12:16 2022] DELETE /identity/v3/projects/841d01e964364ef3818ee8e2b8249c5b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:12:17.043359 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed95f7-2135-4f80-a8d5-019a16ea8c33 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:17.044337 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed95f7-2135-4f80-a8d5-019a16ea8c33 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:17.044453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed95f7-2135-4f80-a8d5-019a16ea8c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:17.086355 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cbed95f7-2135-4f80-a8d5-019a16ea8c33 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:17.087826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cbed95f7-2135-4f80-a8d5-019a16ea8c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:17.157231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 943/1886] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:17.165117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7044c-6caa-4208-8a68-792fb3242f14 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:17.165430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7044c-6caa-4208-8a68-792fb3242f14 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:17.165707 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7044c-6caa-4208-8a68-792fb3242f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:17.187647 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d7e7044c-6caa-4208-8a68-792fb3242f14 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:17.189350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d7e7044c-6caa-4208-8a68-792fb3242f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:17.198321 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 944/1887] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:17.202858 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed95f7-2135-4f80-a8d5-019a16ea8c33 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:17.212987 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed95f7-2135-4f80-a8d5-019a16ea8c33 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:17.218454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729565c-e924-42f8-96fe-8a7612d94264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:17.219186 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729565c-e924-42f8-96fe-8a7612d94264 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:17.219742 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729565c-e924-42f8-96fe-8a7612d94264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:17.220089 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729565c-e924-42f8-96fe-8a7612d94264 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:17.220833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729565c-e924-42f8-96fe-8a7612d94264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:12:17.221168 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729565c-e924-42f8-96fe-8a7612d94264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:17.223235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729565c-e924-42f8-96fe-8a7612d94264 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:17.243220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 944/1888] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:12:17.244358 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7044c-6caa-4208-8a68-792fb3242f14 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:17.255172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7044c-6caa-4208-8a68-792fb3242f14 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:17.261226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c6597-a0ad-4475-a717-68b3940ef6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:17.267722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c6597-a0ad-4475-a717-68b3940ef6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:17.267722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c6597-a0ad-4475-a717-68b3940ef6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:17.267722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c6597-a0ad-4475-a717-68b3940ef6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:17.267722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c6597-a0ad-4475-a717-68b3940ef6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:17.267722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5c6597-a0ad-4475-a717-68b3940ef6a2 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:17.470478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 945/1889] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:12:17 2022] POST /identity/v3/projects => generated 369 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:12:17.471822 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729565c-e924-42f8-96fe-8a7612d94264 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:17.486502 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729565c-e924-42f8-96fe-8a7612d94264 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:17.544700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0a1a1-820a-4f19-a7ed-af38013ecdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:17.545859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0a1a1-820a-4f19-a7ed-af38013ecdfb admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:17.546133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0a1a1-820a-4f19-a7ed-af38013ecdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:17.546403 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0a1a1-820a-4f19-a7ed-af38013ecdfb admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:17.547127 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0a1a1-820a-4f19-a7ed-af38013ecdfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:17.549436 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0a1a1-820a-4f19-a7ed-af38013ecdfb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:17.669872 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 945/1890] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:12:17 2022] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:12:17.674095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c6597-a0ad-4475-a717-68b3940ef6a2 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:17.684844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c6597-a0ad-4475-a717-68b3940ef6a2 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:17.689153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134a7f3-5a9b-451a-8cf9-1ac92ccbb4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:17.689792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134a7f3-5a9b-451a-8cf9-1ac92ccbb4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:17.690066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134a7f3-5a9b-451a-8cf9-1ac92ccbb4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:17.690330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134a7f3-5a9b-451a-8cf9-1ac92ccbb4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:17.691075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134a7f3-5a9b-451a-8cf9-1ac92ccbb4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:17.692694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134a7f3-5a9b-451a-8cf9-1ac92ccbb4b5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:17.705205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 946/1891] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:12:17.708942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0a1a1-820a-4f19-a7ed-af38013ecdfb admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:17.720274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0a1a1-820a-4f19-a7ed-af38013ecdfb admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:17.725069 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60f8f2-2020-42c9-bd2c-4a7664065af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:17.731507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60f8f2-2020-42c9-bd2c-4a7664065af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:17.731507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60f8f2-2020-42c9-bd2c-4a7664065af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:17.731507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60f8f2-2020-42c9-bd2c-4a7664065af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:17.731507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60f8f2-2020-42c9-bd2c-4a7664065af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:17.731507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60f8f2-2020-42c9-bd2c-4a7664065af1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:17.731507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:17.744393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 946/1892] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:12:17.745898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134a7f3-5a9b-451a-8cf9-1ac92ccbb4b5 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:17.757514 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134a7f3-5a9b-451a-8cf9-1ac92ccbb4b5 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:17.763605 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86fde3-31a8-482e-bde6-5079a4d1f0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:17.764505 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86fde3-31a8-482e-bde6-5079a4d1f0d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:17.764788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86fde3-31a8-482e-bde6-5079a4d1f0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:17.765035 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86fde3-31a8-482e-bde6-5079a4d1f0d1 admin admin] PATH_INFO: `/v3/projects/7baa395b4c214a389f025408704b00a5/users/1df923d989944d65b1e2aa8a7e82832a/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:17.783597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86fde3-31a8-482e-bde6-5079a4d1f0d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7baa395b4c214a389f025408704b00a5, user_id=1df923d989944d65b1e2aa8a7e82832a, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:17.786333 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86fde3-31a8-482e-bde6-5079a4d1f0d1 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:17.882250 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 947/1893] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:12:17 2022] PUT /identity/v3/projects/7baa395b4c214a389f025408704b00a5/users/1df923d989944d65b1e2aa8a7e82832a/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:12:17.888222 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82732fa-af0b-4d16-a653-0d02b0cdc9dc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:17.888603 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82732fa-af0b-4d16-a653-0d02b0cdc9dc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:17.888873 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82732fa-af0b-4d16-a653-0d02b0cdc9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:17.909187 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d82732fa-af0b-4d16-a653-0d02b0cdc9dc None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:17.910446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d82732fa-af0b-4d16-a653-0d02b0cdc9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:17.973974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 947/1894] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:12:17.983881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86fde3-31a8-482e-bde6-5079a4d1f0d1 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:17.985724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7a86fde3-31a8-482e-bde6-5079a4d1f0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:18.050275 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86fde3-31a8-482e-bde6-5079a4d1f0d1 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:18.053424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57830c-5194-4c4f-b220-d65c50320f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:18.054045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57830c-5194-4c4f-b220-d65c50320f39 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:18.054346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57830c-5194-4c4f-b220-d65c50320f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:18.054613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57830c-5194-4c4f-b220-d65c50320f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:18.064729 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57830c-5194-4c4f-b220-d65c50320f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:18.066191 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57830c-5194-4c4f-b220-d65c50320f39 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:18.077318 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 948/1895] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:18.658491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:20.086526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34470-cfb8-4c06-89e5-e64712272770 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:20.087015 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34470-cfb8-4c06-89e5-e64712272770 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:20.087122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e34470-cfb8-4c06-89e5-e64712272770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:20.108061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-61e34470-cfb8-4c06-89e5-e64712272770 None None] MFA Rules not processed for user `093519cbc8564b859c01a3a3ab1aae3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:20.109271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-61e34470-cfb8-4c06-89e5-e64712272770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:20.173229 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 948/1896] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:12:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:20.248351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1451d7-40d9-40ba-b673-3cf7b24bc5e0 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:20.248830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1451d7-40d9-40ba-b673-3cf7b24bc5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:20.249175 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1451d7-40d9-40ba-b673-3cf7b24bc5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:20.282944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-6d1451d7-40d9-40ba-b673-3cf7b24bc5e0 None None] MFA Rules not processed for user `1df923d989944d65b1e2aa8a7e82832a`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:20.284443 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6d1451d7-40d9-40ba-b673-3cf7b24bc5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:20.378438 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 949/1897] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:12:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:20.382885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e34470-cfb8-4c06-89e5-e64712272770 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:20.394947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e34470-cfb8-4c06-89e5-e64712272770 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:20.399702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32568c-5943-4d7a-985b-bbcb19bd6135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:20.402950 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32568c-5943-4d7a-985b-bbcb19bd6135 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:20.402950 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32568c-5943-4d7a-985b-bbcb19bd6135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:20.402950 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32568c-5943-4d7a-985b-bbcb19bd6135 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:20.402950 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32568c-5943-4d7a-985b-bbcb19bd6135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:20.403750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32568c-5943-4d7a-985b-bbcb19bd6135 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:20.470888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 949/1898] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:12:20 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:12:20.475646 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1451d7-40d9-40ba-b673-3cf7b24bc5e0 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:20.486644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1451d7-40d9-40ba-b673-3cf7b24bc5e0 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:20.544267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f438852-8c5f-4b72-8d40-377ad95680f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:20.544880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f438852-8c5f-4b72-8d40-377ad95680f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:20.545155 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f438852-8c5f-4b72-8d40-377ad95680f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:20.545519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f438852-8c5f-4b72-8d40-377ad95680f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:20.546187 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f438852-8c5f-4b72-8d40-377ad95680f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:20.548149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f438852-8c5f-4b72-8d40-377ad95680f0 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:20.624460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 950/1899] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:12:20 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:12:20.628852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32568c-5943-4d7a-985b-bbcb19bd6135 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:20.640433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32568c-5943-4d7a-985b-bbcb19bd6135 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:20.646078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b2b46-dccc-4f2b-912d-954a83a2d9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:20.646737 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b2b46-dccc-4f2b-912d-954a83a2d9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:20.647128 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b2b46-dccc-4f2b-912d-954a83a2d9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:20.647507 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b2b46-dccc-4f2b-912d-954a83a2d9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:20.648165 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b2b46-dccc-4f2b-912d-954a83a2d9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:20.649824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b2b46-dccc-4f2b-912d-954a83a2d9b1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:20.661002 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 950/1900] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:12:20.665250 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f438852-8c5f-4b72-8d40-377ad95680f0 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:20.676166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f438852-8c5f-4b72-8d40-377ad95680f0 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:20.681213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadbc45-bcd0-4fbf-bb39-7aa326dbf96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:20.681906 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadbc45-bcd0-4fbf-bb39-7aa326dbf96d admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:20.682184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadbc45-bcd0-4fbf-bb39-7aa326dbf96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:20.682457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadbc45-bcd0-4fbf-bb39-7aa326dbf96d admin admin] PATH_INFO: `/v3/projects/057954e9174e4b8596b3ac477d865bd0/users/e409558f79fa483aa3a702944317b1b2/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:20.698209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadbc45-bcd0-4fbf-bb39-7aa326dbf96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=057954e9174e4b8596b3ac477d865bd0, user_id=e409558f79fa483aa3a702944317b1b2, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:20.701172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadbc45-bcd0-4fbf-bb39-7aa326dbf96d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:20.789027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 951/1901] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:12:20 2022] PUT /identity/v3/projects/057954e9174e4b8596b3ac477d865bd0/users/e409558f79fa483aa3a702944317b1b2/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:12:20.790088 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b2b46-dccc-4f2b-912d-954a83a2d9b1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:20.801972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b2b46-dccc-4f2b-912d-954a83a2d9b1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:20.865682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc232e9a-5836-4bc6-a968-a1a0343d9082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:20.866417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc232e9a-5836-4bc6-a968-a1a0343d9082 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:20.866649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc232e9a-5836-4bc6-a968-a1a0343d9082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:20.866841 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc232e9a-5836-4bc6-a968-a1a0343d9082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:20.867488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc232e9a-5836-4bc6-a968-a1a0343d9082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:20.869147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc232e9a-5836-4bc6-a968-a1a0343d9082 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:20.888949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 951/1902] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:12:20.893157 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadbc45-bcd0-4fbf-bb39-7aa326dbf96d admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:20.905094 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadbc45-bcd0-4fbf-bb39-7aa326dbf96d admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:20.910102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ef499-6360-46c0-9298-f5d22495273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:20.925078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ef499-6360-46c0-9298-f5d22495273d admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:20.925078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ef499-6360-46c0-9298-f5d22495273d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:20.925078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ef499-6360-46c0-9298-f5d22495273d admin admin] PATH_INFO: `/v3/projects/057954e9174e4b8596b3ac477d865bd0/users/e409558f79fa483aa3a702944317b1b2/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:20.925078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ef499-6360-46c0-9298-f5d22495273d admin admin] RBAC: Authorizing `identity:create_grant(project_id=057954e9174e4b8596b3ac477d865bd0, user_id=e409558f79fa483aa3a702944317b1b2, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:20.925078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ef499-6360-46c0-9298-f5d22495273d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:20.930514 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 952/1903] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:12:20 2022] PUT /identity/v3/projects/057954e9174e4b8596b3ac477d865bd0/users/e409558f79fa483aa3a702944317b1b2/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:12:22.198632 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338bee-09a0-49b4-a922-413af813076a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:22.199177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338bee-09a0-49b4-a922-413af813076a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:22.199177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9338bee-09a0-49b4-a922-413af813076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:22.215614 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:22.231690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a9338bee-09a0-49b4-a922-413af813076a None None] MFA Rules not processed for user `e409558f79fa483aa3a702944317b1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:22.232940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a9338bee-09a0-49b4-a922-413af813076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:22.308518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 952/1904] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:12:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:22.319890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67a1a-6750-45ea-aee2-2bf29ca7d3b6 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:22.323281 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67a1a-6750-45ea-aee2-2bf29ca7d3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:22.323281 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67a1a-6750-45ea-aee2-2bf29ca7d3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:22.347922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-36f67a1a-6750-45ea-aee2-2bf29ca7d3b6 None None] MFA Rules not processed for user `1df923d989944d65b1e2aa8a7e82832a`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:22.347922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-36f67a1a-6750-45ea-aee2-2bf29ca7d3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:22.385060 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:22.421635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 953/1905] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:12:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:22.569990 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9338bee-09a0-49b4-a922-413af813076a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:22.571728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a9338bee-09a0-49b4-a922-413af813076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:22.650335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9338bee-09a0-49b4-a922-413af813076a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:22.656405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee765b4-9ff5-4e0e-900d-66ab7c49bb6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:22.657032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee765b4-9ff5-4e0e-900d-66ab7c49bb6d service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:22.657374 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee765b4-9ff5-4e0e-900d-66ab7c49bb6d service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:22.657653 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee765b4-9ff5-4e0e-900d-66ab7c49bb6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:22.665455 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee765b4-9ff5-4e0e-900d-66ab7c49bb6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:22.667019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee765b4-9ff5-4e0e-900d-66ab7c49bb6d service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:22.676696 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 953/1906] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:32.445666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=12 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:32.672476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=65 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:12:38.953265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086273c1-0f9b-48af-be03-dd63d4e91430 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:38.953827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086273c1-0f9b-48af-be03-dd63d4e91430 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:38.953918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086273c1-0f9b-48af-be03-dd63d4e91430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:38.976539 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-086273c1-0f9b-48af-be03-dd63d4e91430 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:38.977836 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-086273c1-0f9b-48af-be03-dd63d4e91430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:39.059329 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 954/1907] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Oct 31 15:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:39.083592 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee765b4-9ff5-4e0e-900d-66ab7c49bb6d service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:39.085049 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6ee765b4-9ff5-4e0e-900d-66ab7c49bb6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:39.099766 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee765b4-9ff5-4e0e-900d-66ab7c49bb6d service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:39.105494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c874c-a60d-4db4-93c1-5dbae828c4d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:39.106193 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c874c-a60d-4db4-93c1-5dbae828c4d0 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:39.106471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c874c-a60d-4db4-93c1-5dbae828c4d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:39.106760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c874c-a60d-4db4-93c1-5dbae828c4d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:39.115472 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c874c-a60d-4db4-93c1-5dbae828c4d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:39.116958 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c874c-a60d-4db4-93c1-5dbae828c4d0 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:39.127959 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 954/1908] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:46.301081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce896e4-2a79-47b5-907f-5449a6be2681 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:46.301888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce896e4-2a79-47b5-907f-5449a6be2681 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:46.301998 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce896e4-2a79-47b5-907f-5449a6be2681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:46.325391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-9ce896e4-2a79-47b5-907f-5449a6be2681 None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:46.325391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9ce896e4-2a79-47b5-907f-5449a6be2681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:46.380972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 955/1909] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:12:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:12:46.423045 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c874c-a60d-4db4-93c1-5dbae828c4d0 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:46.424442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aa7c874c-a60d-4db4-93c1-5dbae828c4d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:46.478058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fbe56-8cdc-4370-a3c6-ae464f50acec None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:46.478340 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fbe56-8cdc-4370-a3c6-ae464f50acec None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:46.478637 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fbe56-8cdc-4370-a3c6-ae464f50acec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:46.497437 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c874c-a60d-4db4-93c1-5dbae828c4d0 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:46.500112 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d67fbe56-8cdc-4370-a3c6-ae464f50acec None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:46.501409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d67fbe56-8cdc-4370-a3c6-ae464f50acec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:46.502763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c24fcc-6b4f-4cd4-b797-de5ad4acf0a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:46.503376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c24fcc-6b4f-4cd4-b797-de5ad4acf0a1 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:46.503654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c24fcc-6b4f-4cd4-b797-de5ad4acf0a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:46.503929 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c24fcc-6b4f-4cd4-b797-de5ad4acf0a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:46.509887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 956/1910] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Oct 31 15:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:12:46.512812 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c24fcc-6b4f-4cd4-b797-de5ad4acf0a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:46.514418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c24fcc-6b4f-4cd4-b797-de5ad4acf0a1 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:46.524587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fbe56-8cdc-4370-a3c6-ae464f50acec None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:46.525261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 955/1911] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:12:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:12:46.539370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fbe56-8cdc-4370-a3c6-ae464f50acec None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:46.546229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eb771-79c9-40f9-8978-0b9161f2ef96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:46.552584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eb771-79c9-40f9-8978-0b9161f2ef96 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:46.552584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eb771-79c9-40f9-8978-0b9161f2ef96 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:46.552584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eb771-79c9-40f9-8978-0b9161f2ef96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:46.557263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10eb771-79c9-40f9-8978-0b9161f2ef96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:46.558965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10eb771-79c9-40f9-8978-0b9161f2ef96 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:46.571733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 957/1912] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:12:48.008318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c24fcc-6b4f-4cd4-b797-de5ad4acf0a1 service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:48.010389 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-34c24fcc-6b4f-4cd4-b797-de5ad4acf0a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:48.100759 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c24fcc-6b4f-4cd4-b797-de5ad4acf0a1 service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:48.104909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd5140-60a9-44c1-8420-2ce297cba0b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:48.105673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd5140-60a9-44c1-8420-2ce297cba0b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:48.106708 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd5140-60a9-44c1-8420-2ce297cba0b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:48.107001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd5140-60a9-44c1-8420-2ce297cba0b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:48.119429 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd5140-60a9-44c1-8420-2ce297cba0b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:48.120905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd5140-60a9-44c1-8420-2ce297cba0b9 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:48.135014 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 956/1913] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:52.136780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62174c00-b663-4511-9d54-3aee4b585aaf None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:52.138030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62174c00-b663-4511-9d54-3aee4b585aaf None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:52.138509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62174c00-b663-4511-9d54-3aee4b585aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:52.165578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-62174c00-b663-4511-9d54-3aee4b585aaf None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:52.170542 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-62174c00-b663-4511-9d54-3aee4b585aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:52.183750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 958/1914] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Oct 31 15:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:52.203751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd5140-60a9-44c1-8420-2ce297cba0b9 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:52.217859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd5140-60a9-44c1-8420-2ce297cba0b9 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:52.223743 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8af39-ebd9-494a-84db-f82fa620b9fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:52.224576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8af39-ebd9-494a-84db-f82fa620b9fd service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:52.224849 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8af39-ebd9-494a-84db-f82fa620b9fd service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:52.225460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8af39-ebd9-494a-84db-f82fa620b9fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:52.235563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8af39-ebd9-494a-84db-f82fa620b9fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:52.237386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8af39-ebd9-494a-84db-f82fa620b9fd service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:52.248598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 957/1915] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:12:58.241512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba40e2-1fd5-4977-b43c-8aae7f1094a5 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:58.241512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba40e2-1fd5-4977-b43c-8aae7f1094a5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:58.241512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba40e2-1fd5-4977-b43c-8aae7f1094a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:58.269169 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-f5ba40e2-1fd5-4977-b43c-8aae7f1094a5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:12:58.269169 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f5ba40e2-1fd5-4977-b43c-8aae7f1094a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:12:58.277368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 959/1916] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Oct 31 15:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:12:58.299712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8af39-ebd9-494a-84db-f82fa620b9fd service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:12:58.312892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8af39-ebd9-494a-84db-f82fa620b9fd service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:12:58.318967 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44217635-5bab-4e42-8686-221767b09965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:12:58.319656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44217635-5bab-4e42-8686-221767b09965 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:12:58.319998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44217635-5bab-4e42-8686-221767b09965 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:12:58.320330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44217635-5bab-4e42-8686-221767b09965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:12:58.333033 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44217635-5bab-4e42-8686-221767b09965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:12:58.334750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44217635-5bab-4e42-8686-221767b09965 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:12:58.346065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 958/1917] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:13:03.579283 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1851303-8964-4a07-a057-cd6486cc3656 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:03.579814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1851303-8964-4a07-a057-cd6486cc3656 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:03.579814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1851303-8964-4a07-a057-cd6486cc3656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:03.587466 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=68 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:03.600647 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-c1851303-8964-4a07-a057-cd6486cc3656 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:03.601812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c1851303-8964-4a07-a057-cd6486cc3656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:03.609789 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 960/1918] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Oct 31 15:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:03.628265 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44217635-5bab-4e42-8686-221767b09965 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:03.633955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=77 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:03.640484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44217635-5bab-4e42-8686-221767b09965 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:03.646081 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce3d3e-e0d3-4655-b9aa-eae25129452a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:03.646680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce3d3e-e0d3-4655-b9aa-eae25129452a service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:03.646955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce3d3e-e0d3-4655-b9aa-eae25129452a service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:03.647226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce3d3e-e0d3-4655-b9aa-eae25129452a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:03.656173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce3d3e-e0d3-4655-b9aa-eae25129452a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:03.657853 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce3d3e-e0d3-4655-b9aa-eae25129452a service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:03.667277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 959/1919] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:13:07.385959 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d2ad-5689-4191-b204-97ff1e6ff7ef None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:07.387075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d2ad-5689-4191-b204-97ff1e6ff7ef None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:07.388094 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d2ad-5689-4191-b204-97ff1e6ff7ef None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:07.390027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 961/1920] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 31 15:13:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:13:07.396726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa68099-69d7-40a3-8795-a7daa063ec46 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:07.397204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa68099-69d7-40a3-8795-a7daa063ec46 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:07.397344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa68099-69d7-40a3-8795-a7daa063ec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:07.416868 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5aa68099-69d7-40a3-8795-a7daa063ec46 None None] MFA Rules not processed for user `9ec30e419d6f4fddb05c4bb08f2ce3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:07.418661 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5aa68099-69d7-40a3-8795-a7daa063ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:07.434925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 960/1921] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 31 15:13:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:07.454639 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d2ad-5689-4191-b204-97ff1e6ff7ef None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:07.456358 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-1008d2ad-5689-4191-b204-97ff1e6ff7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:07.514184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d2ad-5689-4191-b204-97ff1e6ff7ef None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:07.517810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57294442-d1db-4ad4-962b-c98a82bff291 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74317ae6b47843de85d03f3a9d3a811d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:07.518346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57294442-d1db-4ad4-962b-c98a82bff291 service glance] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:07.518621 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57294442-d1db-4ad4-962b-c98a82bff291 service glance] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:07.518890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57294442-d1db-4ad4-962b-c98a82bff291 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:07.529437 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57294442-d1db-4ad4-962b-c98a82bff291 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:07.530850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57294442-d1db-4ad4-962b-c98a82bff291 service glance] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:07.541371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 962/1922] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:13:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:13:07.716031 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf042b-ee54-4970-8c8f-1d589b639e09 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:07.716323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf042b-ee54-4970-8c8f-1d589b639e09 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:07.716595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf042b-ee54-4970-8c8f-1d589b639e09 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:07.718023 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 961/1923] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 31 15:13:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:13:07.722778 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648cd37-a157-4ae1-8fe5-c2d07bd578da None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:07.723064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648cd37-a157-4ae1-8fe5-c2d07bd578da None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:07.723337 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648cd37-a157-4ae1-8fe5-c2d07bd578da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:07.744046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-9648cd37-a157-4ae1-8fe5-c2d07bd578da None None] MFA Rules not processed for user `93815827ae97419abf6fa45fbab185f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:07.745299 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9648cd37-a157-4ae1-8fe5-c2d07bd578da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:07.798248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 963/1924] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 31 15:13:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:07.810732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf042b-ee54-4970-8c8f-1d589b639e09 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:07.826387 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf042b-ee54-4970-8c8f-1d589b639e09 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:07.829032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680b881-abf9-4234-9659-83036e4ab62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:07.830008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680b881-abf9-4234-9659-83036e4ab62b service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:07.830543 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680b881-abf9-4234-9659-83036e4ab62b service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:07.831026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680b881-abf9-4234-9659-83036e4ab62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:07.839145 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680b881-abf9-4234-9659-83036e4ab62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:07.841279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680b881-abf9-4234-9659-83036e4ab62b service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:07.849974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 962/1925] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:13:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:13:07.946704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74398927-aa87-4bc7-a49f-bb8940916070 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:07.947181 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74398927-aa87-4bc7-a49f-bb8940916070 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:07.947450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74398927-aa87-4bc7-a49f-bb8940916070 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:07.948810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 964/1926] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 31 15:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:13:07.954947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f5335-8fc1-4f15-b6d5-5b1d7c6530a7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:07.955230 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f5335-8fc1-4f15-b6d5-5b1d7c6530a7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:07.955503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f5335-8fc1-4f15-b6d5-5b1d7c6530a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:07.979788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d62f5335-8fc1-4f15-b6d5-5b1d7c6530a7 None None] MFA Rules not processed for user `9ec30e419d6f4fddb05c4bb08f2ce3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:07.981211 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d62f5335-8fc1-4f15-b6d5-5b1d7c6530a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:07.992453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 963/1927] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 31 15:13:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:08.003404 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74398927-aa87-4bc7-a49f-bb8940916070 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:08.005527 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-74398927-aa87-4bc7-a49f-bb8940916070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:08.019130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74398927-aa87-4bc7-a49f-bb8940916070 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:08.022732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017e264-2bed-43a6-a0f8-361b23197572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:08.023321 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017e264-2bed-43a6-a0f8-361b23197572 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:08.023596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017e264-2bed-43a6-a0f8-361b23197572 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:08.023862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017e264-2bed-43a6-a0f8-361b23197572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:08.035964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017e264-2bed-43a6-a0f8-361b23197572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:08.037730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017e264-2bed-43a6-a0f8-361b23197572 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:08.050446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 965/1928] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:13:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:13:08.848346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca99cf-5f5d-48f2-bd19-6af2e28bdf9c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:08.848825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca99cf-5f5d-48f2-bd19-6af2e28bdf9c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:08.848916 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca99cf-5f5d-48f2-bd19-6af2e28bdf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:08.868482 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c0ca99cf-5f5d-48f2-bd19-6af2e28bdf9c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:08.871767 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c0ca99cf-5f5d-48f2-bd19-6af2e28bdf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:08.878039 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 964/1929] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Oct 31 15:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:08.893233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017e264-2bed-43a6-a0f8-361b23197572 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:08.905106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017e264-2bed-43a6-a0f8-361b23197572 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:08.910934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faadd30-1221-44b3-b843-4f5f38c00cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:08.911538 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faadd30-1221-44b3-b843-4f5f38c00cd3 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:08.911929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faadd30-1221-44b3-b843-4f5f38c00cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:08.912199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faadd30-1221-44b3-b843-4f5f38c00cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:08.921665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faadd30-1221-44b3-b843-4f5f38c00cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:08.923213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faadd30-1221-44b3-b843-4f5f38c00cd3 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:08.933019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 966/1930] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:13:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:13:14.584312 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e65f-51b1-45cc-9976-fc799e128ef6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:14.584875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e65f-51b1-45cc-9976-fc799e128ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:14.584875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e65f-51b1-45cc-9976-fc799e128ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:14.605394 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fce9e65f-51b1-45cc-9976-fc799e128ef6 None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:14.607081 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fce9e65f-51b1-45cc-9976-fc799e128ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:14.614174 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 965/1931] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:13:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:14.626115 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faadd30-1221-44b3-b843-4f5f38c00cd3 service nova] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:14.638136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faadd30-1221-44b3-b843-4f5f38c00cd3 service nova] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:14.643237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9fa97-ff17-4973-8c9c-a93b1f9f91d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:14.643795 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9fa97-ff17-4973-8c9c-a93b1f9f91d0 service swift] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:14.644072 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9fa97-ff17-4973-8c9c-a93b1f9f91d0 service swift] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:14.644339 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9fa97-ff17-4973-8c9c-a93b1f9f91d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:14.653122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9fa97-ff17-4973-8c9c-a93b1f9f91d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:14.654757 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9fa97-ff17-4973-8c9c-a93b1f9f91d0 service swift] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:14.662888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 967/1932] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:13:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:13:18.514963 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e65f-51b1-45cc-9976-fc799e128ef6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:18.527089 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e65f-51b1-45cc-9976-fc799e128ef6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:18.531855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:18.532482 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:18.532756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:18.533024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] PATH_INFO: `/v3/users/1df923d989944d65b1e2aa8a7e82832a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:18.534223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1df923d989944d65b1e2aa8a7e82832a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:18.536122 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:18.718654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1df923d989944d65b1e2aa8a7e82832a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:18.719315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1df923d989944d65b1e2aa8a7e82832a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:18.726220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1df923d989944d65b1e2aa8a7e82832a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:18.781903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1df923d989944d65b1e2aa8a7e82832a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:18.794913 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1df923d989944d65b1e2aa8a7e82832a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:18.800779 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 966/1933] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:13:18 2022] DELETE /identity/v3/users/1df923d989944d65b1e2aa8a7e82832a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:13:19.366271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9fa97-ff17-4973-8c9c-a93b1f9f91d0 service swift] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:19.378722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9fa97-ff17-4973-8c9c-a93b1f9f91d0 service swift] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:19.443322 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:19.444055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:19.444363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:19.444635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] PATH_INFO: `/v3/projects/7baa395b4c214a389f025408704b00a5` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:19.445890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7baa395b4c214a389f025408704b00a5)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:19.447986 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:19.461960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:19.616629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7baa395b4c214a389f025408704b00a5', 'request_id': 'req-0bb9af41-9140-4e19-ac7e-683f9df4951f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:19.725013 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7baa395b4c214a389f025408704b00a5', 'request_id': 'req-0bb9af41-9140-4e19-ac7e-683f9df4951f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:19.732133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7baa395b4c214a389f025408704b00a5', 'request_id': 'req-0bb9af41-9140-4e19-ac7e-683f9df4951f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:19.743089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] The token cache is being invalidate because project 7baa395b4c214a389f025408704b00a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:13:19.743382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:19.744062 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:19.745683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 968/1934] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:13:19 2022] DELETE /identity/v3/projects/7baa395b4c214a389f025408704b00a5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:13:19.750123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:19.751505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:19.765527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dae26b-3134-475c-8d12-ae4a2d93e155 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:19.819817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46efaa-4a3c-4324-a289-58e2c56676e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:19.820434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46efaa-4a3c-4324-a289-58e2c56676e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:19.820746 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46efaa-4a3c-4324-a289-58e2c56676e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:19.821017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46efaa-4a3c-4324-a289-58e2c56676e1 admin admin] PATH_INFO: `/v3/users/e409558f79fa483aa3a702944317b1b2` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:19.822129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46efaa-4a3c-4324-a289-58e2c56676e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e409558f79fa483aa3a702944317b1b2)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:19.824013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46efaa-4a3c-4324-a289-58e2c56676e1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:19.848794 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:20.063769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fa46efaa-4a3c-4324-a289-58e2c56676e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e409558f79fa483aa3a702944317b1b2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:20.064574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fa46efaa-4a3c-4324-a289-58e2c56676e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e409558f79fa483aa3a702944317b1b2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:20.091277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fa46efaa-4a3c-4324-a289-58e2c56676e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e409558f79fa483aa3a702944317b1b2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:20.178026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fa46efaa-4a3c-4324-a289-58e2c56676e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e409558f79fa483aa3a702944317b1b2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:20.191678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fa46efaa-4a3c-4324-a289-58e2c56676e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e409558f79fa483aa3a702944317b1b2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:20.212774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 967/1935] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:13:19 2022] DELETE /identity/v3/users/e409558f79fa483aa3a702944317b1b2 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:13:20.544816 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:20.544816 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:20.557357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9af41-9140-4e19-ac7e-683f9df4951f admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:20.618687 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68477172-2c93-489c-a9a6-8870a21a169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:20.619313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477172-2c93-489c-a9a6-8870a21a169e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:20.619585 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477172-2c93-489c-a9a6-8870a21a169e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:20.619850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477172-2c93-489c-a9a6-8870a21a169e admin admin] PATH_INFO: `/v3/projects/057954e9174e4b8596b3ac477d865bd0` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:20.620937 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68477172-2c93-489c-a9a6-8870a21a169e admin admin] RBAC: Authorizing `identity:delete_project(project_id=057954e9174e4b8596b3ac477d865bd0)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:20.623066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68477172-2c93-489c-a9a6-8870a21a169e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:20.752383 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-68477172-2c93-489c-a9a6-8870a21a169e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '057954e9174e4b8596b3ac477d865bd0', 'request_id': 'req-68477172-2c93-489c-a9a6-8870a21a169e'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:20.816368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-68477172-2c93-489c-a9a6-8870a21a169e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '057954e9174e4b8596b3ac477d865bd0', 'request_id': 'req-68477172-2c93-489c-a9a6-8870a21a169e'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:20.832273 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-68477172-2c93-489c-a9a6-8870a21a169e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '057954e9174e4b8596b3ac477d865bd0', 'request_id': 'req-68477172-2c93-489c-a9a6-8870a21a169e'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:20.849408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-68477172-2c93-489c-a9a6-8870a21a169e admin admin] The token cache is being invalidate because project 057954e9174e4b8596b3ac477d865bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:13:20.850899 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-68477172-2c93-489c-a9a6-8870a21a169e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:20.850899 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-68477172-2c93-489c-a9a6-8870a21a169e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:20.852060 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 969/1936] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:13:20 2022] DELETE /identity/v3/projects/057954e9174e4b8596b3ac477d865bd0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:13:20.857445 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f32e7-ba95-448c-a748-fe79d07d6a35 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:20.858033 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f32e7-ba95-448c-a748-fe79d07d6a35 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:20.858033 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f32e7-ba95-448c-a748-fe79d07d6a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:20.878136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4e5f32e7-ba95-448c-a748-fe79d07d6a35 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:20.879448 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4e5f32e7-ba95-448c-a748-fe79d07d6a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:20.940926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 968/1937] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:21.005098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f6313-90e5-47d6-b309-34d7a1aec582 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:21.005410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f6313-90e5-47d6-b309-34d7a1aec582 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:21.005681 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f6313-90e5-47d6-b309-34d7a1aec582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:21.025778 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-af1f6313-90e5-47d6-b309-34d7a1aec582 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:21.027043 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-af1f6313-90e5-47d6-b309-34d7a1aec582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:21.034843 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 970/1938] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:21.038918 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f32e7-ba95-448c-a748-fe79d07d6a35 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:21.048579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f32e7-ba95-448c-a748-fe79d07d6a35 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:21.053355 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5488c-0f1a-43c7-99e5-92dbb23a0d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:21.053945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5488c-0f1a-43c7-99e5-92dbb23a0d64 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:21.054218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5488c-0f1a-43c7-99e5-92dbb23a0d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:21.054485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5488c-0f1a-43c7-99e5-92dbb23a0d64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:21.055123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5488c-0f1a-43c7-99e5-92dbb23a0d64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:13:21.055455 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5488c-0f1a-43c7-99e5-92dbb23a0d64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:21.057025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5488c-0f1a-43c7-99e5-92dbb23a0d64 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:21.087483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 969/1939] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:13:21.090740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f6313-90e5-47d6-b309-34d7a1aec582 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:21.100193 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f6313-90e5-47d6-b309-34d7a1aec582 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:21.104873 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cfc9c-c9f9-41ee-abec-d9e5c62d71b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:21.105498 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cfc9c-c9f9-41ee-abec-d9e5c62d71b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:21.105776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cfc9c-c9f9-41ee-abec-d9e5c62d71b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:21.106070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cfc9c-c9f9-41ee-abec-d9e5c62d71b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:21.106730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cfc9c-c9f9-41ee-abec-d9e5c62d71b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:21.108600 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cfc9c-c9f9-41ee-abec-d9e5c62d71b8 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:21.247316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:21.256267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 971/1940] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:13:21 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:13:21.261041 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5488c-0f1a-43c7-99e5-92dbb23a0d64 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:21.272213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5488c-0f1a-43c7-99e5-92dbb23a0d64 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:21.332962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bbfc8-f0d9-484b-804d-1f708e965a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:21.333627 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bbfc8-f0d9-484b-804d-1f708e965a22 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:21.333909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bbfc8-f0d9-484b-804d-1f708e965a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:21.334176 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bbfc8-f0d9-484b-804d-1f708e965a22 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:21.334808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bbfc8-f0d9-484b-804d-1f708e965a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:21.336800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bbfc8-f0d9-484b-804d-1f708e965a22 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:21.410440 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 970/1941] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:13:21 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:13:21.414571 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cfc9c-c9f9-41ee-abec-d9e5c62d71b8 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:21.425648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cfc9c-c9f9-41ee-abec-d9e5c62d71b8 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:21.430535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9c1ed-6410-40a7-bcf4-df46c9a7eeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:21.431126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9c1ed-6410-40a7-bcf4-df46c9a7eeee admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:21.431404 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9c1ed-6410-40a7-bcf4-df46c9a7eeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:21.431675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9c1ed-6410-40a7-bcf4-df46c9a7eeee admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:21.432340 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9c1ed-6410-40a7-bcf4-df46c9a7eeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:21.433994 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9c1ed-6410-40a7-bcf4-df46c9a7eeee admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:21.445663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 972/1942] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:13:21.449488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bbfc8-f0d9-484b-804d-1f708e965a22 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:21.459398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bbfc8-f0d9-484b-804d-1f708e965a22 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:21.463900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fe467-d2f1-403e-93fb-3a0dbb20de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:21.464490 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fe467-d2f1-403e-93fb-3a0dbb20de92 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:21.464764 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fe467-d2f1-403e-93fb-3a0dbb20de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:21.465033 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fe467-d2f1-403e-93fb-3a0dbb20de92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:21.465795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fe467-d2f1-403e-93fb-3a0dbb20de92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:21.467297 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fe467-d2f1-403e-93fb-3a0dbb20de92 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:21.477616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 971/1943] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:13:21.482017 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9c1ed-6410-40a7-bcf4-df46c9a7eeee admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:21.492267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9c1ed-6410-40a7-bcf4-df46c9a7eeee admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:21.497819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901648d1-f552-4a6e-936d-85fae5ecd217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:21.498500 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901648d1-f552-4a6e-936d-85fae5ecd217 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:21.498781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901648d1-f552-4a6e-936d-85fae5ecd217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:21.499052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901648d1-f552-4a6e-936d-85fae5ecd217 admin admin] PATH_INFO: `/v3/projects/d5d0635e48574f2581cfba64dd38284f/users/421bd34238344ebaac8508d03bcbd591/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:21.513962 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901648d1-f552-4a6e-936d-85fae5ecd217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d0635e48574f2581cfba64dd38284f, user_id=421bd34238344ebaac8508d03bcbd591, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:21.516604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901648d1-f552-4a6e-936d-85fae5ecd217 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:21.629162 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 973/1944] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:13:21 2022] PUT /identity/v3/projects/d5d0635e48574f2581cfba64dd38284f/users/421bd34238344ebaac8508d03bcbd591/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:13:21.646280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6984e-096c-4d86-9248-df9fd801ae8d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:21.646914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6984e-096c-4d86-9248-df9fd801ae8d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:21.647426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6984e-096c-4d86-9248-df9fd801ae8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:21.680084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:21.705910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-bcf6984e-096c-4d86-9248-df9fd801ae8d None None] MFA Rules not processed for user `421bd34238344ebaac8508d03bcbd591`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:21.708080 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bcf6984e-096c-4d86-9248-df9fd801ae8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:21.780796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 972/1945] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:13:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:21.791661 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901648d1-f552-4a6e-936d-85fae5ecd217 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:21.793757 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-901648d1-f552-4a6e-936d-85fae5ecd217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:21.885541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901648d1-f552-4a6e-936d-85fae5ecd217 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:21.889773 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fca83-48c2-4a1a-901f-719ab0160a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:21.890535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fca83-48c2-4a1a-901f-719ab0160a8c service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:21.890879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fca83-48c2-4a1a-901f-719ab0160a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:21.891287 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fca83-48c2-4a1a-901f-719ab0160a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:21.900858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fca83-48c2-4a1a-901f-719ab0160a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:21.902342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fca83-48c2-4a1a-901f-719ab0160a8c service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:21.912798 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 974/1946] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:13:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:13:29.328465 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6984e-096c-4d86-9248-df9fd801ae8d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:29.389874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6984e-096c-4d86-9248-df9fd801ae8d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:29.394293 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:29.394936 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:29.395207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:29.395492 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] PATH_INFO: `/v3/users/421bd34238344ebaac8508d03bcbd591` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:29.396585 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=421bd34238344ebaac8508d03bcbd591)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:29.398490 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:29.595894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421bd34238344ebaac8508d03bcbd591'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:29.596529 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421bd34238344ebaac8508d03bcbd591'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:29.603580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421bd34238344ebaac8508d03bcbd591'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:29.644688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421bd34238344ebaac8508d03bcbd591'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:29.657979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421bd34238344ebaac8508d03bcbd591'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:29.664066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 973/1947] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:13:29 2022] DELETE /identity/v3/users/421bd34238344ebaac8508d03bcbd591 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:13:29.668562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063e49-e722-4b2a-a757-8c6fbb2e90f4 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:29.669148 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063e49-e722-4b2a-a757-8c6fbb2e90f4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:29.669148 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063e49-e722-4b2a-a757-8c6fbb2e90f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:29.688285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-80063e49-e722-4b2a-a757-8c6fbb2e90f4 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:29.689514 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-80063e49-e722-4b2a-a757-8c6fbb2e90f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:29.749217 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 975/1948] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:29.761372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:29.763248 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:29.782268 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:29.819449 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e73f5-6573-408b-8e03-0fbaa5b6a9bf admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:29.823197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0baa254-66ca-4495-8a24-74118b871bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:29.825521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0baa254-66ca-4495-8a24-74118b871bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:29.825521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0baa254-66ca-4495-8a24-74118b871bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:29.825521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0baa254-66ca-4495-8a24-74118b871bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:29.834037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0baa254-66ca-4495-8a24-74118b871bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:29.835455 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0baa254-66ca-4495-8a24-74118b871bc3 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:29.845809 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 974/1949] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:13:30.206688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80063e49-e722-4b2a-a757-8c6fbb2e90f4 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:30.208121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-80063e49-e722-4b2a-a757-8c6fbb2e90f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:30.220686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80063e49-e722-4b2a-a757-8c6fbb2e90f4 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:30.225317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939429b7-c251-4625-92da-11eff8dbdc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:30.229068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939429b7-c251-4625-92da-11eff8dbdc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:30.229068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939429b7-c251-4625-92da-11eff8dbdc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:30.229068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939429b7-c251-4625-92da-11eff8dbdc94 admin admin] PATH_INFO: `/v3/projects/d5d0635e48574f2581cfba64dd38284f` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:30.229068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939429b7-c251-4625-92da-11eff8dbdc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d0635e48574f2581cfba64dd38284f)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:30.229632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939429b7-c251-4625-92da-11eff8dbdc94 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:30.353446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-939429b7-c251-4625-92da-11eff8dbdc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d0635e48574f2581cfba64dd38284f', 'request_id': 'req-939429b7-c251-4625-92da-11eff8dbdc94'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:30.410170 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-939429b7-c251-4625-92da-11eff8dbdc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d0635e48574f2581cfba64dd38284f', 'request_id': 'req-939429b7-c251-4625-92da-11eff8dbdc94'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:30.416496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-939429b7-c251-4625-92da-11eff8dbdc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d0635e48574f2581cfba64dd38284f', 'request_id': 'req-939429b7-c251-4625-92da-11eff8dbdc94'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:30.418496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:30.427900 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-939429b7-c251-4625-92da-11eff8dbdc94 admin admin] The token cache is being invalidate because project d5d0635e48574f2581cfba64dd38284f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:13:30.428182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-939429b7-c251-4625-92da-11eff8dbdc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:30.428801 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-939429b7-c251-4625-92da-11eff8dbdc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:13:30.430287 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 976/1950] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:13:30 2022] DELETE /identity/v3/projects/d5d0635e48574f2581cfba64dd38284f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:13:30.435991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e41de9-b37f-4457-bda8-c290413eb626 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:30.436453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e41de9-b37f-4457-bda8-c290413eb626 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:30.436556 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e41de9-b37f-4457-bda8-c290413eb626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:30.455720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f7e41de9-b37f-4457-bda8-c290413eb626 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:30.459410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f7e41de9-b37f-4457-bda8-c290413eb626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:30.515265 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 975/1951] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:30.523974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aff2a-4445-43da-a433-ab67e08edcc6 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:30.524255 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aff2a-4445-43da-a433-ab67e08edcc6 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:30.524526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aff2a-4445-43da-a433-ab67e08edcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:30.544353 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e62aff2a-4445-43da-a433-ab67e08edcc6 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:30.545712 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e62aff2a-4445-43da-a433-ab67e08edcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:30.553788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 977/1952] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:30.557973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e41de9-b37f-4457-bda8-c290413eb626 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:30.568422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e41de9-b37f-4457-bda8-c290413eb626 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:30.573006 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407cbbe-a360-4177-bae8-56cb670aa934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:30.573630 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407cbbe-a360-4177-bae8-56cb670aa934 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:30.573909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407cbbe-a360-4177-bae8-56cb670aa934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:30.574181 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407cbbe-a360-4177-bae8-56cb670aa934 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:30.574818 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407cbbe-a360-4177-bae8-56cb670aa934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:13:30.575300 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407cbbe-a360-4177-bae8-56cb670aa934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:30.576920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407cbbe-a360-4177-bae8-56cb670aa934 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:30.588327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 976/1953] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:13:30.592649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62aff2a-4445-43da-a433-ab67e08edcc6 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:30.601852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62aff2a-4445-43da-a433-ab67e08edcc6 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:30.606970 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd68b0-a825-4f21-8eb0-cb30969c16e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:30.607561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd68b0-a825-4f21-8eb0-cb30969c16e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:30.607835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd68b0-a825-4f21-8eb0-cb30969c16e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:30.608101 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd68b0-a825-4f21-8eb0-cb30969c16e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:30.608726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd68b0-a825-4f21-8eb0-cb30969c16e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:30.610740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd68b0-a825-4f21-8eb0-cb30969c16e4 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:30.708320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 978/1954] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:13:30 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:13:30.719787 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407cbbe-a360-4177-bae8-56cb670aa934 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:30.729719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407cbbe-a360-4177-bae8-56cb670aa934 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:30.787418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90911f47-0dbc-4a4a-9566-77346c03af99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:30.788050 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90911f47-0dbc-4a4a-9566-77346c03af99 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:30.788324 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90911f47-0dbc-4a4a-9566-77346c03af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:30.788590 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90911f47-0dbc-4a4a-9566-77346c03af99 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:30.789225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90911f47-0dbc-4a4a-9566-77346c03af99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:30.791182 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90911f47-0dbc-4a4a-9566-77346c03af99 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:30.890774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 977/1955] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:13:30 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:13:30.894869 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd68b0-a825-4f21-8eb0-cb30969c16e4 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:30.906060 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd68b0-a825-4f21-8eb0-cb30969c16e4 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:30.910809 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb4f2d-1580-444b-94c1-b5ceae7af80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:30.911400 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb4f2d-1580-444b-94c1-b5ceae7af80e admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:30.911677 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb4f2d-1580-444b-94c1-b5ceae7af80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:30.911948 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb4f2d-1580-444b-94c1-b5ceae7af80e admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:30.912594 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb4f2d-1580-444b-94c1-b5ceae7af80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:30.914209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb4f2d-1580-444b-94c1-b5ceae7af80e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:30.924727 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 979/1956] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:13:30.928893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90911f47-0dbc-4a4a-9566-77346c03af99 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:30.939044 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90911f47-0dbc-4a4a-9566-77346c03af99 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:30.943697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5b144-1ef2-42f4-8310-09438f362f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:30.944364 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5b144-1ef2-42f4-8310-09438f362f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:30.944704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5b144-1ef2-42f4-8310-09438f362f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:30.945027 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5b144-1ef2-42f4-8310-09438f362f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:30.945691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5b144-1ef2-42f4-8310-09438f362f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:30.947284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5b144-1ef2-42f4-8310-09438f362f34 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:30.958208 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 978/1957] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:13:30.962174 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb4f2d-1580-444b-94c1-b5ceae7af80e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:30.973161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb4f2d-1580-444b-94c1-b5ceae7af80e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:30.978772 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b0ac1-2b2d-45e7-b5ae-842a68bce72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:30.979423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b0ac1-2b2d-45e7-b5ae-842a68bce72e admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:30.979699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b0ac1-2b2d-45e7-b5ae-842a68bce72e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:30.979967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b0ac1-2b2d-45e7-b5ae-842a68bce72e admin admin] PATH_INFO: `/v3/projects/b11928623e7848caacfb29720392863a/users/7e6a3667229b4927b8c29727d1c62498/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:30.995580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b0ac1-2b2d-45e7-b5ae-842a68bce72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11928623e7848caacfb29720392863a, user_id=7e6a3667229b4927b8c29727d1c62498, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:30.998275 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b0ac1-2b2d-45e7-b5ae-842a68bce72e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:31.091194 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 980/1958] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:13:30 2022] PUT /identity/v3/projects/b11928623e7848caacfb29720392863a/users/7e6a3667229b4927b8c29727d1c62498/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:13:31.096916 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56daa7-1e6b-452a-8948-3a824ba73d17 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:31.097199 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56daa7-1e6b-452a-8948-3a824ba73d17 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:31.097499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56daa7-1e6b-452a-8948-3a824ba73d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:31.116941 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5f56daa7-1e6b-452a-8948-3a824ba73d17 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:31.118225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5f56daa7-1e6b-452a-8948-3a824ba73d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:31.137107 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:31.178519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 979/1959] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:31.193377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b0ac1-2b2d-45e7-b5ae-842a68bce72e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:31.195131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c57b0ac1-2b2d-45e7-b5ae-842a68bce72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:31.255369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b0ac1-2b2d-45e7-b5ae-842a68bce72e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:31.259134 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb89365-fcf1-4b76-90cb-cc4b5e5a1c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:31.259821 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb89365-fcf1-4b76-90cb-cc4b5e5a1c14 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:31.260100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb89365-fcf1-4b76-90cb-cc4b5e5a1c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:31.260370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb89365-fcf1-4b76-90cb-cc4b5e5a1c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:31.270700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb89365-fcf1-4b76-90cb-cc4b5e5a1c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:31.272130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb89365-fcf1-4b76-90cb-cc4b5e5a1c14 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:31.282537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 981/1960] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:13:32.394375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc38ed-d44f-4796-84eb-5c4f59235ff2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:32.394804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc38ed-d44f-4796-84eb-5c4f59235ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:32.394940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc38ed-d44f-4796-84eb-5c4f59235ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:32.429874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c9bc38ed-d44f-4796-84eb-5c4f59235ff2 None None] MFA Rules not processed for user `7e6a3667229b4927b8c29727d1c62498`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:32.431123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c9bc38ed-d44f-4796-84eb-5c4f59235ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:32.501378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 980/1961] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:13:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:32.512270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb89365-fcf1-4b76-90cb-cc4b5e5a1c14 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:32.514929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-fbb89365-fcf1-4b76-90cb-cc4b5e5a1c14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:32.577110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb89365-fcf1-4b76-90cb-cc4b5e5a1c14 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:32.580787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c1b1c-a0d9-4122-988e-f0e4967e58fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:32.581445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c1b1c-a0d9-4122-988e-f0e4967e58fb service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:32.581724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c1b1c-a0d9-4122-988e-f0e4967e58fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:32.581997 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c1b1c-a0d9-4122-988e-f0e4967e58fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:32.590794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c1b1c-a0d9-4122-988e-f0e4967e58fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:32.592283 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c1b1c-a0d9-4122-988e-f0e4967e58fb service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:32.601222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 982/1962] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:13:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:13:35.254214 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b4760-914b-4c11-a09c-db5a4de87ae5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:35.254729 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b4760-914b-4c11-a09c-db5a4de87ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:35.254842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b4760-914b-4c11-a09c-db5a4de87ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:35.274152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-989b4760-914b-4c11-a09c-db5a4de87ae5 None None] MFA Rules not processed for user `7e6a3667229b4927b8c29727d1c62498`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:35.275286 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-989b4760-914b-4c11-a09c-db5a4de87ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:35.282729 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 981/1963] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:13:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:13:42.597131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=82,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:13:44.839213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2003c1a-9142-49dd-ad20-b709bb0037c3 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:44.839808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2003c1a-9142-49dd-ad20-b709bb0037c3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:44.839808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2003c1a-9142-49dd-ad20-b709bb0037c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:44.862044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-b2003c1a-9142-49dd-ad20-b709bb0037c3 None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:44.863279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b2003c1a-9142-49dd-ad20-b709bb0037c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:44.941839 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 983/1964] 10.222.0.45 () {58 vars in 967 bytes} [Mon Oct 31 15:13:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:44.956239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b4760-914b-4c11-a09c-db5a4de87ae5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:13:44.958068 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-989b4760-914b-4c11-a09c-db5a4de87ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:45.043282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b4760-914b-4c11-a09c-db5a4de87ae5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:13:45.050256 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983dc3a9-03fa-4a3c-9446-345a6ec3ab34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:13:45.052202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dc3a9-03fa-4a3c-9446-345a6ec3ab34 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:45.052611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dc3a9-03fa-4a3c-9446-345a6ec3ab34 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:45.053142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dc3a9-03fa-4a3c-9446-345a6ec3ab34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:45.063374 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983dc3a9-03fa-4a3c-9446-345a6ec3ab34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:13:45.065226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983dc3a9-03fa-4a3c-9446-345a6ec3ab34 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:13:45.075683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 982/1965] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:13:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:13:50.983540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda66409-b19e-4efb-a24d-b9c53409748a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:13:50.983942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda66409-b19e-4efb-a24d-b9c53409748a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:13:50.984077 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda66409-b19e-4efb-a24d-b9c53409748a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:13:51.002826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-dda66409-b19e-4efb-a24d-b9c53409748a None None] MFA Rules not processed for user `439c5a2ae9bb433489b2424505eed9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:13:51.004044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-dda66409-b19e-4efb-a24d-b9c53409748a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:13:51.057791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 984/1966] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:13:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:13:55.070573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=83 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:01.051150 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=50 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:06.324922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523b56-9efa-48bf-8391-33b9ace63ced None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:06.325976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523b56-9efa-48bf-8391-33b9ace63ced None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:06.326148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523b56-9efa-48bf-8391-33b9ace63ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:06.345503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fd523b56-9efa-48bf-8391-33b9ace63ced None None] MFA Rules not processed for user `7e6a3667229b4927b8c29727d1c62498`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:06.346694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fd523b56-9efa-48bf-8391-33b9ace63ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:06.353399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 983/1967] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:14:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:09.611526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda66409-b19e-4efb-a24d-b9c53409748a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:09.612959 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-dda66409-b19e-4efb-a24d-b9c53409748a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:09.625966 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda66409-b19e-4efb-a24d-b9c53409748a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:09.629793 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c9dff-32b8-4bec-bf48-c122acaf582b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:09.630405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c9dff-32b8-4bec-bf48-c122acaf582b service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:09.635274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c9dff-32b8-4bec-bf48-c122acaf582b service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:09.635274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c9dff-32b8-4bec-bf48-c122acaf582b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:09.635274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-963c9dff-32b8-4bec-bf48-c122acaf582b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:09.710222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c9dff-32b8-4bec-bf48-c122acaf582b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:09.711648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c9dff-32b8-4bec-bf48-c122acaf582b service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:09.724277 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 985/1968] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:10.536729 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523b56-9efa-48bf-8391-33b9ace63ced None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:10.548085 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523b56-9efa-48bf-8391-33b9ace63ced None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:10.552566 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790f0ef-d062-4d36-9f9e-8fc43f0fc8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:10.553479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790f0ef-d062-4d36-9f9e-8fc43f0fc8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:10.554008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790f0ef-d062-4d36-9f9e-8fc43f0fc8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:10.554483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790f0ef-d062-4d36-9f9e-8fc43f0fc8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:10.556644 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9790f0ef-d062-4d36-9f9e-8fc43f0fc8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:10.571031 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790f0ef-d062-4d36-9f9e-8fc43f0fc8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:10.572455 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790f0ef-d062-4d36-9f9e-8fc43f0fc8d5 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:10.584003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 984/1969] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:15.656881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba1bbc-2e06-4959-86de-8e43f5a07a7b None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:15.657478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba1bbc-2e06-4959-86de-8e43f5a07a7b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:15.657478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba1bbc-2e06-4959-86de-8e43f5a07a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:15.678134 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-19ba1bbc-2e06-4959-86de-8e43f5a07a7b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:15.679341 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-19ba1bbc-2e06-4959-86de-8e43f5a07a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:15.687591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 986/1970] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Oct 31 15:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:15.703038 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790f0ef-d062-4d36-9f9e-8fc43f0fc8d5 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:15.704453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9790f0ef-d062-4d36-9f9e-8fc43f0fc8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:15.718523 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790f0ef-d062-4d36-9f9e-8fc43f0fc8d5 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:15.724041 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cab186-30d3-4652-81da-34191ad2f7d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:15.724637 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cab186-30d3-4652-81da-34191ad2f7d3 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:15.725092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cab186-30d3-4652-81da-34191ad2f7d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:15.725405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cab186-30d3-4652-81da-34191ad2f7d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:15.735194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cab186-30d3-4652-81da-34191ad2f7d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:15.736776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cab186-30d3-4652-81da-34191ad2f7d3 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:15.747343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 985/1971] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:21.350216 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba1bbc-2e06-4959-86de-8e43f5a07a7b None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:21.362509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba1bbc-2e06-4959-86de-8e43f5a07a7b None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:21.367863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd5a35-b02c-4305-ad93-58a8f86538e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:21.368449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd5a35-b02c-4305-ad93-58a8f86538e6 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:21.368720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd5a35-b02c-4305-ad93-58a8f86538e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:21.368984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd5a35-b02c-4305-ad93-58a8f86538e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:21.370694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-76dd5a35-b02c-4305-ad93-58a8f86538e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:21.429884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd5a35-b02c-4305-ad93-58a8f86538e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:21.431464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd5a35-b02c-4305-ad93-58a8f86538e6 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:21.440614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 987/1972] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:22.065576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea81f01-0239-468a-8400-f0a19d2a08be None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:22.066102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea81f01-0239-468a-8400-f0a19d2a08be None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:22.066200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea81f01-0239-468a-8400-f0a19d2a08be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:22.086100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6ea81f01-0239-468a-8400-f0a19d2a08be None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:22.087286 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6ea81f01-0239-468a-8400-f0a19d2a08be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:22.095924 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 986/1973] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Oct 31 15:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:22.113770 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd5a35-b02c-4305-ad93-58a8f86538e6 service nova] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:22.124763 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd5a35-b02c-4305-ad93-58a8f86538e6 service nova] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:22.130280 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400c4db-9395-4186-b47f-a923082bcc21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:22.130870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400c4db-9395-4186-b47f-a923082bcc21 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:22.131144 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400c4db-9395-4186-b47f-a923082bcc21 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:22.131411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400c4db-9395-4186-b47f-a923082bcc21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:22.141058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400c4db-9395-4186-b47f-a923082bcc21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:22.142694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400c4db-9395-4186-b47f-a923082bcc21 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:22.152182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 988/1974] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:26.866979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fadd9-7e79-416a-b8d1-d553cf287e96 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:26.867468 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fadd9-7e79-416a-b8d1-d553cf287e96 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:26.867560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fadd9-7e79-416a-b8d1-d553cf287e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:26.888790 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d13fadd9-7e79-416a-b8d1-d553cf287e96 None None] MFA Rules not processed for user `4adb546848a744b3a3ed4d77bc02c0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:26.890171 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d13fadd9-7e79-416a-b8d1-d553cf287e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:26.956618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 987/1975] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:14:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:27.091156 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92934fd2-e291-48d4-94cb-a6a9fdae29e5 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:27.091699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92934fd2-e291-48d4-94cb-a6a9fdae29e5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:27.091819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92934fd2-e291-48d4-94cb-a6a9fdae29e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:27.114357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-92934fd2-e291-48d4-94cb-a6a9fdae29e5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:27.116395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-92934fd2-e291-48d4-94cb-a6a9fdae29e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:27.128898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 989/1976] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Oct 31 15:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:27.257553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fadd9-7e79-416a-b8d1-d553cf287e96 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:27.259038 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d13fadd9-7e79-416a-b8d1-d553cf287e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:27.275609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fadd9-7e79-416a-b8d1-d553cf287e96 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:27.281658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec1e9a-9123-4884-9b6c-76a3d86b44aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:27.282268 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec1e9a-9123-4884-9b6c-76a3d86b44aa service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:27.282665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec1e9a-9123-4884-9b6c-76a3d86b44aa service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:27.282803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec1e9a-9123-4884-9b6c-76a3d86b44aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:27.291495 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec1e9a-9123-4884-9b6c-76a3d86b44aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:27.293633 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec1e9a-9123-4884-9b6c-76a3d86b44aa service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:27.303563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 988/1977] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:29.034823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92934fd2-e291-48d4-94cb-a6a9fdae29e5 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:29.047696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92934fd2-e291-48d4-94cb-a6a9fdae29e5 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:29.053417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3943118-a729-441e-aa7d-05d3cacfb8dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:29.054009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3943118-a729-441e-aa7d-05d3cacfb8dc service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:29.054289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3943118-a729-441e-aa7d-05d3cacfb8dc service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:29.054557 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3943118-a729-441e-aa7d-05d3cacfb8dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:29.056273 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a3943118-a729-441e-aa7d-05d3cacfb8dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:29.117313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:29.120157 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3943118-a729-441e-aa7d-05d3cacfb8dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:29.122330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3943118-a729-441e-aa7d-05d3cacfb8dc service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:29.131977 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 990/1978] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:30.929642 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec1e9a-9123-4884-9b6c-76a3d86b44aa service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:30.940577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec1e9a-9123-4884-9b6c-76a3d86b44aa service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:30.946161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42553b-1ded-4f73-bef7-bd9c3c066d26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:30.946634 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42553b-1ded-4f73-bef7-bd9c3c066d26 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:30.946908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42553b-1ded-4f73-bef7-bd9c3c066d26 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:30.947175 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42553b-1ded-4f73-bef7-bd9c3c066d26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:30.948913 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3c42553b-1ded-4f73-bef7-bd9c3c066d26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:30.959353 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42553b-1ded-4f73-bef7-bd9c3c066d26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:30.960988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42553b-1ded-4f73-bef7-bd9c3c066d26 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:30.970584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 989/1979] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:36.524304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db483c85-b836-4266-a735-9708e3a91484 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:36.524818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db483c85-b836-4266-a735-9708e3a91484 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:36.524818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db483c85-b836-4266-a735-9708e3a91484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:36.545032 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-db483c85-b836-4266-a735-9708e3a91484 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:36.546246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-db483c85-b836-4266-a735-9708e3a91484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:36.554162 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 991/1980] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Oct 31 15:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:36.568956 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42553b-1ded-4f73-bef7-bd9c3c066d26 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:36.575134 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=56 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:36.581144 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42553b-1ded-4f73-bef7-bd9c3c066d26 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:36.586671 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97aba1-7951-4f0d-9d32-79a746d00706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:36.587262 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97aba1-7951-4f0d-9d32-79a746d00706 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:36.587538 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97aba1-7951-4f0d-9d32-79a746d00706 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:36.587809 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97aba1-7951-4f0d-9d32-79a746d00706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:36.596998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97aba1-7951-4f0d-9d32-79a746d00706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:36.598980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97aba1-7951-4f0d-9d32-79a746d00706 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:36.609207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 990/1981] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:42.535159 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db483c85-b836-4266-a735-9708e3a91484 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:42.548646 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db483c85-b836-4266-a735-9708e3a91484 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:42.552916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641163ac-29bc-431a-9508-898e1b016d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:42.553831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641163ac-29bc-431a-9508-898e1b016d92 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:42.554345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641163ac-29bc-431a-9508-898e1b016d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:42.555247 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641163ac-29bc-431a-9508-898e1b016d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:42.557137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-641163ac-29bc-431a-9508-898e1b016d92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:42.568970 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641163ac-29bc-431a-9508-898e1b016d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:42.572226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641163ac-29bc-431a-9508-898e1b016d92 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:42.590298 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 992/1982] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:43.936746 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377bc1a-4e67-4f12-8352-c3ae207ee386 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:43.937247 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377bc1a-4e67-4f12-8352-c3ae207ee386 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:43.937389 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377bc1a-4e67-4f12-8352-c3ae207ee386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:43.957999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9377bc1a-4e67-4f12-8352-c3ae207ee386 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:43.959186 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9377bc1a-4e67-4f12-8352-c3ae207ee386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:43.967991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 991/1983] 10.222.0.23 () {58 vars in 1016 bytes} [Mon Oct 31 15:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:14:44.058835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641163ac-29bc-431a-9508-898e1b016d92 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:44.071566 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641163ac-29bc-431a-9508-898e1b016d92 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:44.077762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdca2c7-1237-4231-9a63-78f1e2709885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:44.078365 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdca2c7-1237-4231-9a63-78f1e2709885 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:44.078639 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdca2c7-1237-4231-9a63-78f1e2709885 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:44.078905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdca2c7-1237-4231-9a63-78f1e2709885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:44.087190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdca2c7-1237-4231-9a63-78f1e2709885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:44.088752 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdca2c7-1237-4231-9a63-78f1e2709885 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:44.098842 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 993/1984] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:44.729406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d29b0-0220-4955-9e48-73f7a6bc868e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:44.729693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d29b0-0220-4955-9e48-73f7a6bc868e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:44.729968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d29b0-0220-4955-9e48-73f7a6bc868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:44.753028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b27d29b0-0220-4955-9e48-73f7a6bc868e None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:44.754270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b27d29b0-0220-4955-9e48-73f7a6bc868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:44.761505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 992/1985] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:14:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:44.875990 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdca2c7-1237-4231-9a63-78f1e2709885 service nova] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:44.887811 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdca2c7-1237-4231-9a63-78f1e2709885 service nova] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:44.892650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ad246-478d-4148-841b-99ff34e08721 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:44.893229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ad246-478d-4148-841b-99ff34e08721 service swift] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:44.893531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ad246-478d-4148-841b-99ff34e08721 service swift] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:44.893796 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ad246-478d-4148-841b-99ff34e08721 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:44.901618 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ad246-478d-4148-841b-99ff34e08721 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:44.903945 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ad246-478d-4148-841b-99ff34e08721 service swift] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:44.913075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 994/1986] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:14:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:14:49.615680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d29b0-0220-4955-9e48-73f7a6bc868e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:49.646825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d29b0-0220-4955-9e48-73f7a6bc868e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:49.684680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaffe35-397b-4e9a-a000-713eff376088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:49.685990 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaffe35-397b-4e9a-a000-713eff376088 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:49.686539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaffe35-397b-4e9a-a000-713eff376088 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:49.687130 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaffe35-397b-4e9a-a000-713eff376088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:49.689467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4aaffe35-397b-4e9a-a000-713eff376088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:49.708519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaffe35-397b-4e9a-a000-713eff376088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:49.714306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaffe35-397b-4e9a-a000-713eff376088 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:49.735099 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 993/1987] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:14:54.909294 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=23 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:55.664064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a138a-eda4-449f-a178-8a75c00674b3 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:55.664342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a138a-eda4-449f-a178-8a75c00674b3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:55.664856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a138a-eda4-449f-a178-8a75c00674b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:55.686728 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-417a138a-eda4-449f-a178-8a75c00674b3 None None] MFA Rules not processed for user `093519cbc8564b859c01a3a3ab1aae3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:14:55.688216 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-417a138a-eda4-449f-a178-8a75c00674b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:55.695470 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 995/1988] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:14:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:14:56.128123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaffe35-397b-4e9a-a000-713eff376088 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:56.139158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaffe35-397b-4e9a-a000-713eff376088 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:56.143062 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cacebd-c86a-4947-93bb-3cdcb4776279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:56.143991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cacebd-c86a-4947-93bb-3cdcb4776279 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:56.144272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cacebd-c86a-4947-93bb-3cdcb4776279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:56.144556 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cacebd-c86a-4947-93bb-3cdcb4776279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:56.147142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d2cacebd-c86a-4947-93bb-3cdcb4776279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:56.172261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cacebd-c86a-4947-93bb-3cdcb4776279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:56.173793 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cacebd-c86a-4947-93bb-3cdcb4776279 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:56.187016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 994/1989] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:14:56.676184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a138a-eda4-449f-a178-8a75c00674b3 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:14:56.678464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-417a138a-eda4-449f-a178-8a75c00674b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:56.772582 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a138a-eda4-449f-a178-8a75c00674b3 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:14:56.779009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed558683-6bb2-451f-b323-af907801b603 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:14:56.779670 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed558683-6bb2-451f-b323-af907801b603 service placement] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:14:56.779967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed558683-6bb2-451f-b323-af907801b603 service placement] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:14:56.780253 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed558683-6bb2-451f-b323-af907801b603 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:14:56.782119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ed558683-6bb2-451f-b323-af907801b603 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:14:56.795397 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed558683-6bb2-451f-b323-af907801b603 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:14:56.797240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed558683-6bb2-451f-b323-af907801b603 service placement] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:14:56.808499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 996/1990] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:14:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:03.362289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efbeba-c2e1-4867-9d90-53abb16b9a4d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:03.365313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efbeba-c2e1-4867-9d90-53abb16b9a4d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:03.365313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efbeba-c2e1-4867-9d90-53abb16b9a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:03.383619 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b1efbeba-c2e1-4867-9d90-53abb16b9a4d None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:03.384919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b1efbeba-c2e1-4867-9d90-53abb16b9a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:03.392382 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 995/1991] 10.222.0.45 () {58 vars in 967 bytes} [Mon Oct 31 15:15:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:03.402119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed558683-6bb2-451f-b323-af907801b603 service placement] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:03.405786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efbeba-c2e1-4867-9d90-53abb16b9a4d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:03.415178 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed558683-6bb2-451f-b323-af907801b603 service placement] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:03.419307 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efbeba-c2e1-4867-9d90-53abb16b9a4d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:03.422206 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517eed8d-b511-4dec-a7bd-1f0eae68613b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:03.422871 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517eed8d-b511-4dec-a7bd-1f0eae68613b service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:03.423354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517eed8d-b511-4dec-a7bd-1f0eae68613b service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:03.423716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517eed8d-b511-4dec-a7bd-1f0eae68613b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:03.424275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2271b0-ea74-4808-9836-165902cc0e80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:03.424929 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2271b0-ea74-4808-9836-165902cc0e80 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:03.425204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2271b0-ea74-4808-9836-165902cc0e80 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:03.425503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2271b0-ea74-4808-9836-165902cc0e80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:03.425996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-517eed8d-b511-4dec-a7bd-1f0eae68613b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:03.435823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2271b0-ea74-4808-9836-165902cc0e80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:03.437456 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2271b0-ea74-4808-9836-165902cc0e80 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:03.446200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 996/1992] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 31 15:15:03.490907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517eed8d-b511-4dec-a7bd-1f0eae68613b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:03.492420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517eed8d-b511-4dec-a7bd-1f0eae68613b service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:03.502107 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 997/1993] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:06.601306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2271b0-ea74-4808-9836-165902cc0e80 service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:06.602903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5a2271b0-ea74-4808-9836-165902cc0e80 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:06.612266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=33 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:06.618283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2271b0-ea74-4808-9836-165902cc0e80 service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:06.624755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919c08e-3d85-4293-8bd5-d80c3cee0be6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:06.625579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c08e-3d85-4293-8bd5-d80c3cee0be6 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:06.625818 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c08e-3d85-4293-8bd5-d80c3cee0be6 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:06.626098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c08e-3d85-4293-8bd5-d80c3cee0be6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:06.627919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7919c08e-3d85-4293-8bd5-d80c3cee0be6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:06.640304 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919c08e-3d85-4293-8bd5-d80c3cee0be6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:06.648326 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919c08e-3d85-4293-8bd5-d80c3cee0be6 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:06.652832 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 997/1994] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:06.805932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517eed8d-b511-4dec-a7bd-1f0eae68613b service nova] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:06.818893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517eed8d-b511-4dec-a7bd-1f0eae68613b service nova] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:06.823423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:06.824034 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:06.824457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:06.827225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] PATH_INFO: `/v3/users/7e6a3667229b4927b8c29727d1c62498` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:06.828558 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6a3667229b4927b8c29727d1c62498)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:06.830640 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:07.045789 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6a3667229b4927b8c29727d1c62498'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:07.046364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6a3667229b4927b8c29727d1c62498'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:07.063873 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6a3667229b4927b8c29727d1c62498'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:07.064596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6a3667229b4927b8c29727d1c62498'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:07.140449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6a3667229b4927b8c29727d1c62498'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:07.145768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:07.155027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 998/1995] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:15:06 2022] DELETE /identity/v3/users/7e6a3667229b4927b8c29727d1c62498 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:15:07.456967 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919c08e-3d85-4293-8bd5-d80c3cee0be6 service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:07.472146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919c08e-3d85-4293-8bd5-d80c3cee0be6 service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:07.532046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:07.532445 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:07.532730 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:07.533004 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] PATH_INFO: `/v3/projects/b11928623e7848caacfb29720392863a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:07.534172 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11928623e7848caacfb29720392863a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:07.536105 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:07.723786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11928623e7848caacfb29720392863a', 'request_id': 'req-c770bdc1-3613-471f-959e-2478b0523663'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:07.797240 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11928623e7848caacfb29720392863a', 'request_id': 'req-c770bdc1-3613-471f-959e-2478b0523663'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:07.806241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11928623e7848caacfb29720392863a', 'request_id': 'req-c770bdc1-3613-471f-959e-2478b0523663'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:07.818531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] The token cache is being invalidate because project b11928623e7848caacfb29720392863a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:15:07.818818 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:07.820095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:07.821646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 998/1996] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:07 2022] DELETE /identity/v3/projects/b11928623e7848caacfb29720392863a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:15:09.023224 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:09.024853 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:09.108409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62188d-5356-4c4a-b7b1-0e6796674064 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:09.247719 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1440f-942a-4976-ac51-82396b9b05e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:09.248439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1440f-942a-4976-ac51-82396b9b05e8 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:09.248718 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1440f-942a-4976-ac51-82396b9b05e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:09.249606 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1440f-942a-4976-ac51-82396b9b05e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:09.251765 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-fbf1440f-942a-4976-ac51-82396b9b05e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:09.266313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1440f-942a-4976-ac51-82396b9b05e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:09.267909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1440f-942a-4976-ac51-82396b9b05e8 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:09.279247 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 999/1997] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:13.611602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:13.613555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:13.629484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770bdc1-3613-471f-959e-2478b0523663 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:13.635162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403e0fa-99e3-4bb0-a383-40e2bd36642e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:13.636111 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403e0fa-99e3-4bb0-a383-40e2bd36642e service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:13.636388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403e0fa-99e3-4bb0-a383-40e2bd36642e service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:13.636656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403e0fa-99e3-4bb0-a383-40e2bd36642e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:13.638405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0403e0fa-99e3-4bb0-a383-40e2bd36642e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:13.650769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403e0fa-99e3-4bb0-a383-40e2bd36642e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:13.652882 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403e0fa-99e3-4bb0-a383-40e2bd36642e service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:13.663616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 999/1998] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:17.056792 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081809c-1635-45a1-be8e-923ed45dafc6 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:17.057233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081809c-1635-45a1-be8e-923ed45dafc6 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:17.062350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081809c-1635-45a1-be8e-923ed45dafc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:17.077019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0081809c-1635-45a1-be8e-923ed45dafc6 None None] MFA Rules not processed for user `5d83b424ffbc4a879b490d9ac6e84ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:17.078280 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0081809c-1635-45a1-be8e-923ed45dafc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:17.134747 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1000/1999] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:15:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:17.442446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403e0fa-99e3-4bb0-a383-40e2bd36642e service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:17.443957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0403e0fa-99e3-4bb0-a383-40e2bd36642e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:17.502206 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403e0fa-99e3-4bb0-a383-40e2bd36642e service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:17.505863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb6938-d20a-4a82-b5f9-8737b0d9ab98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:17.506466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb6938-d20a-4a82-b5f9-8737b0d9ab98 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:17.506784 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb6938-d20a-4a82-b5f9-8737b0d9ab98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:17.507171 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb6938-d20a-4a82-b5f9-8737b0d9ab98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:17.508896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f6eb6938-d20a-4a82-b5f9-8737b0d9ab98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:17.518461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb6938-d20a-4a82-b5f9-8737b0d9ab98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:17.519871 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb6938-d20a-4a82-b5f9-8737b0d9ab98 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:17.528226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1000/2000] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:25.002940 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081809c-1635-45a1-be8e-923ed45dafc6 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:25.018613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0081809c-1635-45a1-be8e-923ed45dafc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:25.045523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:25.084671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081809c-1635-45a1-be8e-923ed45dafc6 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:25.089479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573ad66-ffc6-443d-b6b7-7a16218df16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:25.090105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573ad66-ffc6-443d-b6b7-7a16218df16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:25.090380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573ad66-ffc6-443d-b6b7-7a16218df16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:25.090647 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573ad66-ffc6-443d-b6b7-7a16218df16a admin admin] PATH_INFO: `/v3/users/439c5a2ae9bb433489b2424505eed9ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:25.091775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573ad66-ffc6-443d-b6b7-7a16218df16a admin admin] RBAC: Authorizing `identity:delete_user(user_id=439c5a2ae9bb433489b2424505eed9ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:25.093752 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573ad66-ffc6-443d-b6b7-7a16218df16a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:25.279087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5573ad66-ffc6-443d-b6b7-7a16218df16a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439c5a2ae9bb433489b2424505eed9ad'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:25.279714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5573ad66-ffc6-443d-b6b7-7a16218df16a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439c5a2ae9bb433489b2424505eed9ad'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:25.291964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5573ad66-ffc6-443d-b6b7-7a16218df16a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439c5a2ae9bb433489b2424505eed9ad'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:25.297914 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5573ad66-ffc6-443d-b6b7-7a16218df16a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439c5a2ae9bb433489b2424505eed9ad'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:25.385633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5573ad66-ffc6-443d-b6b7-7a16218df16a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439c5a2ae9bb433489b2424505eed9ad'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:25.399082 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1001/2001] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:15:25 2022] DELETE /identity/v3/users/439c5a2ae9bb433489b2424505eed9ad => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:15:25.666758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb6938-d20a-4a82-b5f9-8737b0d9ab98 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:25.681910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb6938-d20a-4a82-b5f9-8737b0d9ab98 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:25.687450 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:25.740346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:25.741061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:25.741369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:25.741641 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] PATH_INFO: `/v3/projects/1dc3e134a6904df9b652dc857efc31c0` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:25.742766 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc3e134a6904df9b652dc857efc31c0)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:25.744647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:25.871705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc3e134a6904df9b652dc857efc31c0', 'request_id': 'req-83085d2b-999b-4e03-8585-3cb9aeba44fe'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:25.939935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc3e134a6904df9b652dc857efc31c0', 'request_id': 'req-83085d2b-999b-4e03-8585-3cb9aeba44fe'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:25.946374 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc3e134a6904df9b652dc857efc31c0', 'request_id': 'req-83085d2b-999b-4e03-8585-3cb9aeba44fe'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:25.957422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] The token cache is being invalidate because project 1dc3e134a6904df9b652dc857efc31c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:15:25.957704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:25.958323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:25.959786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1001/2002] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:25 2022] DELETE /identity/v3/projects/1dc3e134a6904df9b652dc857efc31c0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:15:35.395473 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:35.954417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:41.203399 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd5d49-d219-4a6b-bfcb-b04fedbcab78 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:41.203898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd5d49-d219-4a6b-bfcb-b04fedbcab78 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:41.204003 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd5d49-d219-4a6b-bfcb-b04fedbcab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:41.223177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-14cd5d49-d219-4a6b-bfcb-b04fedbcab78 None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:41.224354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-14cd5d49-d219-4a6b-bfcb-b04fedbcab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:41.278255 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1002/2003] 10.222.0.45 () {58 vars in 967 bytes} [Mon Oct 31 15:15:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:41.290506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:41.291916 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:41.359425 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83085d2b-999b-4e03-8585-3cb9aeba44fe admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:41.364329 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7487fb-8074-4933-b037-8975a5e339d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:41.364922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7487fb-8074-4933-b037-8975a5e339d1 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:41.365196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7487fb-8074-4933-b037-8975a5e339d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:41.365495 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7487fb-8074-4933-b037-8975a5e339d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:41.373389 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7487fb-8074-4933-b037-8975a5e339d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:41.375565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7487fb-8074-4933-b037-8975a5e339d1 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:41.383416 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1002/2004] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:15:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:15:45.325750 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87907602-8678-4407-ac77-d5f166472d82 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:45.326282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87907602-8678-4407-ac77-d5f166472d82 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:45.326282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87907602-8678-4407-ac77-d5f166472d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:45.347905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-87907602-8678-4407-ac77-d5f166472d82 None None] MFA Rules not processed for user `e5109f4de7554ecf9840ff6922eb05fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:15:45.349240 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-87907602-8678-4407-ac77-d5f166472d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:45.411358 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1003/2005] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:15:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:15:51.084254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7487fb-8074-4933-b037-8975a5e339d1 service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:51.090855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ae7487fb-8074-4933-b037-8975a5e339d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:51.168722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7487fb-8074-4933-b037-8975a5e339d1 service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:51.174461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecbfd6-3bda-4d75-b632-aac4c456de6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:51.175068 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecbfd6-3bda-4d75-b632-aac4c456de6e service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:51.175348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecbfd6-3bda-4d75-b632-aac4c456de6e service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:51.175622 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecbfd6-3bda-4d75-b632-aac4c456de6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:51.177449 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-67ecbfd6-3bda-4d75-b632-aac4c456de6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:51.190618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecbfd6-3bda-4d75-b632-aac4c456de6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:51.192194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecbfd6-3bda-4d75-b632-aac4c456de6e service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:51.203732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1003/2006] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:15:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:15:51.232836 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87907602-8678-4407-ac77-d5f166472d82 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:51.234521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-87907602-8678-4407-ac77-d5f166472d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:51.317708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87907602-8678-4407-ac77-d5f166472d82 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:51.336975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:51.338154 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:51.338640 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:51.339091 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] PATH_INFO: `/v3/users/fc85e65bf89042f6b79dd93f3ee47443` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:51.340521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc85e65bf89042f6b79dd93f3ee47443)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:51.343812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:51.571209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc85e65bf89042f6b79dd93f3ee47443'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:51.571841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc85e65bf89042f6b79dd93f3ee47443'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:51.576327 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:51.585167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc85e65bf89042f6b79dd93f3ee47443'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:51.585820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc85e65bf89042f6b79dd93f3ee47443'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:51.665056 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc85e65bf89042f6b79dd93f3ee47443'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:51.678544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1004/2007] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:15:51 2022] DELETE /identity/v3/users/fc85e65bf89042f6b79dd93f3ee47443 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:15:51.977367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecbfd6-3bda-4d75-b632-aac4c456de6e service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:51.991439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecbfd6-3bda-4d75-b632-aac4c456de6e service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:52.048765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:52.049414 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:52.049687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:52.049955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] PATH_INFO: `/v3/projects/e40d1aa3d8094546b092968f6e2b6a19` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:52.051054 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40d1aa3d8094546b092968f6e2b6a19)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:52.052922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:52.075927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:52.150702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40d1aa3d8094546b092968f6e2b6a19', 'request_id': 'req-afe8d597-3a38-4fc9-a92f-5b566709a6ca'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:52.214161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40d1aa3d8094546b092968f6e2b6a19', 'request_id': 'req-afe8d597-3a38-4fc9-a92f-5b566709a6ca'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:52.221696 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40d1aa3d8094546b092968f6e2b6a19', 'request_id': 'req-afe8d597-3a38-4fc9-a92f-5b566709a6ca'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:52.233314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] The token cache is being invalidate because project e40d1aa3d8094546b092968f6e2b6a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:15:52.233699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:52.234399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:52.236178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1004/2008] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:51 2022] DELETE /identity/v3/projects/e40d1aa3d8094546b092968f6e2b6a19 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:15:52.240080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:52.242409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:52.256363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830e9c1-1d75-427b-90a0-04d40ee89777 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:52.315768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:52.316395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:52.316671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:52.316941 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] PATH_INFO: `/v3/users/0cffb78189f44137bca684f3ee396845` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:52.318098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cffb78189f44137bca684f3ee396845)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:52.319994 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:52.466732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cffb78189f44137bca684f3ee396845'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:52.468076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cffb78189f44137bca684f3ee396845'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:52.480096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cffb78189f44137bca684f3ee396845'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:52.480664 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cffb78189f44137bca684f3ee396845'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:52.544599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cffb78189f44137bca684f3ee396845'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:52.558433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1005/2009] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:15:52 2022] DELETE /identity/v3/users/0cffb78189f44137bca684f3ee396845 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:15:52.890757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:15:52.892366 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:15:52.906333 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8d597-3a38-4fc9-a92f-5b566709a6ca admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:15:52.965112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:15:52.965771 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:15:52.966048 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:15:52.966316 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] PATH_INFO: `/v3/projects/356845cb4649475f97837ce037f32677` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:15:52.967515 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=356845cb4649475f97837ce037f32677)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:15:52.972656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:15:53.083894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356845cb4649475f97837ce037f32677', 'request_id': 'req-808c8a01-3a3d-4235-a886-8e5b5a641b39'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:53.144857 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356845cb4649475f97837ce037f32677', 'request_id': 'req-808c8a01-3a3d-4235-a886-8e5b5a641b39'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:53.151308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356845cb4649475f97837ce037f32677', 'request_id': 'req-808c8a01-3a3d-4235-a886-8e5b5a641b39'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:53.162157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] The token cache is being invalidate because project 356845cb4649475f97837ce037f32677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:15:53.162438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:53.163051 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:15:53.164643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1005/2010] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:15:52 2022] DELETE /identity/v3/projects/356845cb4649475f97837ce037f32677 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:02.554726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:DELETE=13,keystone:SELECT=63,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:03.159110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:13.566170 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:13.567613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:13.624834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a6839-d5fc-4171-814d-cbc251095084 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:13.672701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a843d-492f-41dc-8efe-1938cf8ed5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:13.673330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a843d-492f-41dc-8efe-1938cf8ed5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:13.673602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a843d-492f-41dc-8efe-1938cf8ed5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:13.673870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a843d-492f-41dc-8efe-1938cf8ed5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:13.675599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b13a843d-492f-41dc-8efe-1938cf8ed5c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:13.736676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a843d-492f-41dc-8efe-1938cf8ed5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:13.738134 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a843d-492f-41dc-8efe-1938cf8ed5c6 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:13.747818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1006/2011] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:17.849344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:17.850900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:17.864454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c8a01-3a3d-4235-a886-8e5b5a641b39 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:17.869109 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fddd85-3378-4b3e-92d8-86c36a2b8fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:17.869875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fddd85-3378-4b3e-92d8-86c36a2b8fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:17.870153 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fddd85-3378-4b3e-92d8-86c36a2b8fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:17.870423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fddd85-3378-4b3e-92d8-86c36a2b8fb9 admin admin] PATH_INFO: `/v3/users/4adb546848a744b3a3ed4d77bc02c0c6` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:17.871539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fddd85-3378-4b3e-92d8-86c36a2b8fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4adb546848a744b3a3ed4d77bc02c0c6)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:17.874210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fddd85-3378-4b3e-92d8-86c36a2b8fb9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:18.107065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-28fddd85-3378-4b3e-92d8-86c36a2b8fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4adb546848a744b3a3ed4d77bc02c0c6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:18.107709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-28fddd85-3378-4b3e-92d8-86c36a2b8fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4adb546848a744b3a3ed4d77bc02c0c6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:18.114693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-28fddd85-3378-4b3e-92d8-86c36a2b8fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4adb546848a744b3a3ed4d77bc02c0c6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:18.190616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-28fddd85-3378-4b3e-92d8-86c36a2b8fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4adb546848a744b3a3ed4d77bc02c0c6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:18.202807 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-28fddd85-3378-4b3e-92d8-86c36a2b8fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4adb546848a744b3a3ed4d77bc02c0c6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:18.212350 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1006/2012] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:16:17 2022] DELETE /identity/v3/users/4adb546848a744b3a3ed4d77bc02c0c6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:18.490069 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a843d-492f-41dc-8efe-1938cf8ed5c6 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:18.502110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a843d-492f-41dc-8efe-1938cf8ed5c6 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:18.559464 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:18.560093 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:18.560368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:18.561388 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c admin admin] PATH_INFO: `/v3/projects/f748698459024d7494f6f9003c2e065a` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:18.562502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f748698459024d7494f6f9003c2e065a)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:18.564412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:18.572244 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:18.671655 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f748698459024d7494f6f9003c2e065a', 'request_id': 'req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:18.744864 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f748698459024d7494f6f9003c2e065a', 'request_id': 'req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:18.751148 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f748698459024d7494f6f9003c2e065a', 'request_id': 'req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:18.761391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c admin admin] The token cache is being invalidate because project f748698459024d7494f6f9003c2e065a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:16:18.761677 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:18.762288 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4f8ecb11-335b-4934-b65e-bc0eeaff5e4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:18.764841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1007/2013] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:18 2022] DELETE /identity/v3/projects/f748698459024d7494f6f9003c2e065a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:18.768672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555cb86-4107-4aa4-be52-4f97bfe28b89 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:18.768953 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555cb86-4107-4aa4-be52-4f97bfe28b89 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:18.769226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555cb86-4107-4aa4-be52-4f97bfe28b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:18.789473 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f555cb86-4107-4aa4-be52-4f97bfe28b89 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:18.790672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f555cb86-4107-4aa4-be52-4f97bfe28b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:18.848513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1007/2014] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:18.856078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf32c30-bf89-446f-aabf-d3f936e057ca None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:18.856389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf32c30-bf89-446f-aabf-d3f936e057ca None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:18.856609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf32c30-bf89-446f-aabf-d3f936e057ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:18.876730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-6cf32c30-bf89-446f-aabf-d3f936e057ca None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:18.877961 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6cf32c30-bf89-446f-aabf-d3f936e057ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:18.885680 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1008/2015] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:18.890017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555cb86-4107-4aa4-be52-4f97bfe28b89 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:18.899484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555cb86-4107-4aa4-be52-4f97bfe28b89 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:18.904053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce350a-d821-4267-942d-a149b4f78d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:18.905249 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce350a-d821-4267-942d-a149b4f78d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:18.905581 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce350a-d821-4267-942d-a149b4f78d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:18.905849 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce350a-d821-4267-942d-a149b4f78d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:18.906493 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce350a-d821-4267-942d-a149b4f78d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:16:18.906794 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce350a-d821-4267-942d-a149b4f78d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:18.908371 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce350a-d821-4267-942d-a149b4f78d1b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:18.919719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1008/2016] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:16:18.924355 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf32c30-bf89-446f-aabf-d3f936e057ca None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:18.933694 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf32c30-bf89-446f-aabf-d3f936e057ca None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:18.938325 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed304f-f2c3-4b47-b467-f907e7a9f017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:18.938907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed304f-f2c3-4b47-b467-f907e7a9f017 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:18.939180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed304f-f2c3-4b47-b467-f907e7a9f017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:18.939446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed304f-f2c3-4b47-b467-f907e7a9f017 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:18.940069 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed304f-f2c3-4b47-b467-f907e7a9f017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:18.941983 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed304f-f2c3-4b47-b467-f907e7a9f017 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:19.061269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1009/2017] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:16:18 2022] POST /identity/v3/projects => generated 355 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:16:19.065440 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce350a-d821-4267-942d-a149b4f78d1b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:19.075426 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce350a-d821-4267-942d-a149b4f78d1b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:19.130875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850c705-054f-4516-bdc4-c2489c13ee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:19.131474 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850c705-054f-4516-bdc4-c2489c13ee1c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:19.131751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850c705-054f-4516-bdc4-c2489c13ee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:19.132018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850c705-054f-4516-bdc4-c2489c13ee1c admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:19.132657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850c705-054f-4516-bdc4-c2489c13ee1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:19.134591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850c705-054f-4516-bdc4-c2489c13ee1c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:19.143083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:19.265914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1009/2018] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:16:19 2022] POST /identity/v3/users => generated 278 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:16:19.270047 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed304f-f2c3-4b47-b467-f907e7a9f017 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:19.280774 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed304f-f2c3-4b47-b467-f907e7a9f017 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:19.285490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aea14f-1afa-495d-b79c-a3e5135ac49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:19.286085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aea14f-1afa-495d-b79c-a3e5135ac49b admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:19.286363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aea14f-1afa-495d-b79c-a3e5135ac49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:19.286648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aea14f-1afa-495d-b79c-a3e5135ac49b admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:19.287270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aea14f-1afa-495d-b79c-a3e5135ac49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:19.288865 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aea14f-1afa-495d-b79c-a3e5135ac49b admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:19.299012 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1010/2019] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:19.306444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850c705-054f-4516-bdc4-c2489c13ee1c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:19.317067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850c705-054f-4516-bdc4-c2489c13ee1c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:19.321737 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed278c1-c85a-4d39-b546-84598f4ff31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:19.322332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed278c1-c85a-4d39-b546-84598f4ff31f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:19.322605 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed278c1-c85a-4d39-b546-84598f4ff31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:19.322873 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed278c1-c85a-4d39-b546-84598f4ff31f admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:19.323508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed278c1-c85a-4d39-b546-84598f4ff31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:19.325070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed278c1-c85a-4d39-b546-84598f4ff31f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:19.336617 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1010/2020] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:19.340747 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aea14f-1afa-495d-b79c-a3e5135ac49b admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:19.350813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aea14f-1afa-495d-b79c-a3e5135ac49b admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:19.355336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921eba2-6f82-4c4d-9914-4a415af34dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:19.355969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921eba2-6f82-4c4d-9914-4a415af34dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:19.356242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921eba2-6f82-4c4d-9914-4a415af34dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:19.356508 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921eba2-6f82-4c4d-9914-4a415af34dd2 admin admin] PATH_INFO: `/v3/projects/ff68be9625cc4eb0b734bdad16fb3585/users/97ad4bae4c7847f9999bbdeffa914ef9/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:19.372078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921eba2-6f82-4c4d-9914-4a415af34dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff68be9625cc4eb0b734bdad16fb3585, user_id=97ad4bae4c7847f9999bbdeffa914ef9, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:19.375350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921eba2-6f82-4c4d-9914-4a415af34dd2 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:19.442520 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1011/2021] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:16:19 2022] PUT /identity/v3/projects/ff68be9625cc4eb0b734bdad16fb3585/users/97ad4bae4c7847f9999bbdeffa914ef9/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:16:19.454731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa28b81-10e6-4578-9564-1ad5751a160d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:19.455012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa28b81-10e6-4578-9564-1ad5751a160d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:19.455281 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa28b81-10e6-4578-9564-1ad5751a160d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:19.484023 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1fa28b81-10e6-4578-9564-1ad5751a160d None None] MFA Rules not processed for user `97ad4bae4c7847f9999bbdeffa914ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:19.485251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1fa28b81-10e6-4578-9564-1ad5751a160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:19.548766 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1011/2022] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:19.553621 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921eba2-6f82-4c4d-9914-4a415af34dd2 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:19.615103 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921eba2-6f82-4c4d-9914-4a415af34dd2 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:19.619631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d4ba9-e2b8-446f-a1fa-9ba2076c3e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:19.620229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d4ba9-e2b8-446f-a1fa-9ba2076c3e92 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:19.620501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d4ba9-e2b8-446f-a1fa-9ba2076c3e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:19.620771 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d4ba9-e2b8-446f-a1fa-9ba2076c3e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:19.621434 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d4ba9-e2b8-446f-a1fa-9ba2076c3e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:19.623825 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d4ba9-e2b8-446f-a1fa-9ba2076c3e92 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:19.717086 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1012/2023] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:16:19 2022] POST /identity/v3/projects => generated 355 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:16:19.721158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa28b81-10e6-4578-9564-1ad5751a160d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:19.731793 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa28b81-10e6-4578-9564-1ad5751a160d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:19.786859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb0108-417a-4498-b6e0-71b3e8b590e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:19.787451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb0108-417a-4498-b6e0-71b3e8b590e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:19.787724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb0108-417a-4498-b6e0-71b3e8b590e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:19.787988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb0108-417a-4498-b6e0-71b3e8b590e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:19.788614 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb0108-417a-4498-b6e0-71b3e8b590e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:19.790522 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb0108-417a-4498-b6e0-71b3e8b590e7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:19.870619 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1012/2024] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:16:19 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:16:19.875131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d4ba9-e2b8-446f-a1fa-9ba2076c3e92 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:19.885500 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d4ba9-e2b8-446f-a1fa-9ba2076c3e92 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:19.890352 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5964e-54f0-4962-a117-6c9c163f277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:19.890943 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5964e-54f0-4962-a117-6c9c163f277a admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:19.891217 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5964e-54f0-4962-a117-6c9c163f277a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:19.891489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5964e-54f0-4962-a117-6c9c163f277a admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:19.892125 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5964e-54f0-4962-a117-6c9c163f277a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:19.893749 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5964e-54f0-4962-a117-6c9c163f277a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:19.904205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1013/2025] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:19.908419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb0108-417a-4498-b6e0-71b3e8b590e7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:19.918522 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb0108-417a-4498-b6e0-71b3e8b590e7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:19.923703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba78b42-316f-40a2-a2e2-fa475b598c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:19.924347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba78b42-316f-40a2-a2e2-fa475b598c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:19.924622 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba78b42-316f-40a2-a2e2-fa475b598c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:19.924895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba78b42-316f-40a2-a2e2-fa475b598c7b admin admin] PATH_INFO: `/v3/projects/0d9c8fd73a7c4277987d4b55ef1aaf39/users/73f4ae832fd84f91a3177001155777d3/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:19.940751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba78b42-316f-40a2-a2e2-fa475b598c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9c8fd73a7c4277987d4b55ef1aaf39, user_id=73f4ae832fd84f91a3177001155777d3, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:19.943444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba78b42-316f-40a2-a2e2-fa475b598c7b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:20.048431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1013/2026] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:16:19 2022] PUT /identity/v3/projects/0d9c8fd73a7c4277987d4b55ef1aaf39/users/73f4ae832fd84f91a3177001155777d3/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:16:20.052608 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5964e-54f0-4962-a117-6c9c163f277a admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:20.063576 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5964e-54f0-4962-a117-6c9c163f277a admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:20.067143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:20.119985 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76672a7e-a8e9-42e8-b0e2-a8c19560c60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:20.120584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672a7e-a8e9-42e8-b0e2-a8c19560c60b admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.120939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672a7e-a8e9-42e8-b0e2-a8c19560c60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.121192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672a7e-a8e9-42e8-b0e2-a8c19560c60b admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.121871 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76672a7e-a8e9-42e8-b0e2-a8c19560c60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:20.123593 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76672a7e-a8e9-42e8-b0e2-a8c19560c60b admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:20.133365 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1014/2027] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:20.137553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba78b42-316f-40a2-a2e2-fa475b598c7b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:20.147997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba78b42-316f-40a2-a2e2-fa475b598c7b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:20.152652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f6965-ac87-4844-8384-032b4a16651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:20.153312 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6965-ac87-4844-8384-032b4a16651e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.153606 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6965-ac87-4844-8384-032b4a16651e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.153880 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6965-ac87-4844-8384-032b4a16651e admin admin] PATH_INFO: `/v3/projects/0d9c8fd73a7c4277987d4b55ef1aaf39/users/73f4ae832fd84f91a3177001155777d3/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.156326 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f6965-ac87-4844-8384-032b4a16651e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9c8fd73a7c4277987d4b55ef1aaf39, user_id=73f4ae832fd84f91a3177001155777d3, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:20.158968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f6965-ac87-4844-8384-032b4a16651e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:20.169074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1014/2028] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:16:20 2022] PUT /identity/v3/projects/0d9c8fd73a7c4277987d4b55ef1aaf39/users/73f4ae832fd84f91a3177001155777d3/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:20.179998 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1e235-63e3-4897-a6cc-2d7a47850a5a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.180281 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1e235-63e3-4897-a6cc-2d7a47850a5a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.180555 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1e235-63e3-4897-a6cc-2d7a47850a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.208643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-a3f1e235-63e3-4897-a6cc-2d7a47850a5a None None] MFA Rules not processed for user `73f4ae832fd84f91a3177001155777d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:20.209901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a3f1e235-63e3-4897-a6cc-2d7a47850a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:20.278936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1015/2029] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:16:20.290274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f6965-ac87-4844-8384-032b4a16651e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:20.291940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d97f6965-ac87-4844-8384-032b4a16651e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:20.315135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:20.352504 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f6965-ac87-4844-8384-032b4a16651e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:20.356237 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf55924-ad3b-41db-a277-8a2140a2609d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:20.356834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55924-ad3b-41db-a277-8a2140a2609d service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.357111 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55924-ad3b-41db-a277-8a2140a2609d service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.357419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf55924-ad3b-41db-a277-8a2140a2609d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.366791 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf55924-ad3b-41db-a277-8a2140a2609d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:20.368200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf55924-ad3b-41db-a277-8a2140a2609d service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:20.378459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1015/2030] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:20.582104 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1e235-63e3-4897-a6cc-2d7a47850a5a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:20.591751 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1e235-63e3-4897-a6cc-2d7a47850a5a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:20.595489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a38c05-ad71-4149-b888-dfad7131bbcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:20.596179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a38c05-ad71-4149-b888-dfad7131bbcd service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:20.596450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a38c05-ad71-4149-b888-dfad7131bbcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:20.596723 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a38c05-ad71-4149-b888-dfad7131bbcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:20.655219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a38c05-ad71-4149-b888-dfad7131bbcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:20.656828 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a38c05-ad71-4149-b888-dfad7131bbcd service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:20.665770 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1016/2031] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:30.374827 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=17 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:30.661615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=88 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:39.461580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf55924-ad3b-41db-a277-8a2140a2609d service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:39.527118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf55924-ad3b-41db-a277-8a2140a2609d service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:39.532747 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:39.533557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:39.533839 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:39.534116 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] PATH_INFO: `/v3/users/97ad4bae4c7847f9999bbdeffa914ef9` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:39.535304 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ad4bae4c7847f9999bbdeffa914ef9)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:39.537241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:39.805850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ad4bae4c7847f9999bbdeffa914ef9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:39.806513 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ad4bae4c7847f9999bbdeffa914ef9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:39.813846 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ad4bae4c7847f9999bbdeffa914ef9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:39.864817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ad4bae4c7847f9999bbdeffa914ef9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:39.878738 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ad4bae4c7847f9999bbdeffa914ef9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:39.885840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1016/2032] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:16:39 2022] DELETE /identity/v3/users/97ad4bae4c7847f9999bbdeffa914ef9 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:39.890879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dee0a-4c24-498e-ab01-e128211d5e15 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:39.891393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dee0a-4c24-498e-ab01-e128211d5e15 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:39.891772 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dee0a-4c24-498e-ab01-e128211d5e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:39.911779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-5f2dee0a-4c24-498e-ab01-e128211d5e15 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:39.913059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5f2dee0a-4c24-498e-ab01-e128211d5e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:39.984770 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1017/2033] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:39.991952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:39.991952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:40.071979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9758eee-7148-4458-b77e-3f4fd99d3330 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:40.074820 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01da0ac-b636-40e9-8c92-bf00418847f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:40.075440 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01da0ac-b636-40e9-8c92-bf00418847f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:40.075720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01da0ac-b636-40e9-8c92-bf00418847f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:40.075994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01da0ac-b636-40e9-8c92-bf00418847f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:40.087096 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01da0ac-b636-40e9-8c92-bf00418847f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:40.088712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01da0ac-b636-40e9-8c92-bf00418847f5 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:40.100527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1017/2034] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:40.547395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dee0a-4c24-498e-ab01-e128211d5e15 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:40.549320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5f2dee0a-4c24-498e-ab01-e128211d5e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:40.565330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dee0a-4c24-498e-ab01-e128211d5e15 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:40.570125 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:40.570761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:40.571296 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:40.571580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] PATH_INFO: `/v3/projects/ff68be9625cc4eb0b734bdad16fb3585` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:40.572720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff68be9625cc4eb0b734bdad16fb3585)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:40.575044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:40.688971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff68be9625cc4eb0b734bdad16fb3585', 'request_id': 'req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:40.802895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff68be9625cc4eb0b734bdad16fb3585', 'request_id': 'req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:40.811645 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff68be9625cc4eb0b734bdad16fb3585', 'request_id': 'req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:40.824481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] The token cache is being invalidate because project ff68be9625cc4eb0b734bdad16fb3585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:16:40.824857 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:40.825679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:40.827336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1018/2035] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:40 2022] DELETE /identity/v3/projects/ff68be9625cc4eb0b734bdad16fb3585 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:40.831409 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01da0ac-b636-40e9-8c92-bf00418847f5 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:40.842114 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01da0ac-b636-40e9-8c92-bf00418847f5 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:40.867059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:40.911921 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ab777-b07e-4219-b41a-68e348f9f63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:40.921218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab777-b07e-4219-b41a-68e348f9f63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:40.921218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab777-b07e-4219-b41a-68e348f9f63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:40.921218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab777-b07e-4219-b41a-68e348f9f63b admin admin] PATH_INFO: `/v3/users/73f4ae832fd84f91a3177001155777d3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:40.921218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ab777-b07e-4219-b41a-68e348f9f63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f4ae832fd84f91a3177001155777d3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:40.921218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ab777-b07e-4219-b41a-68e348f9f63b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:41.167627 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8e5ab777-b07e-4219-b41a-68e348f9f63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f4ae832fd84f91a3177001155777d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:41.168270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8e5ab777-b07e-4219-b41a-68e348f9f63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f4ae832fd84f91a3177001155777d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:41.177260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8e5ab777-b07e-4219-b41a-68e348f9f63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f4ae832fd84f91a3177001155777d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:41.291067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8e5ab777-b07e-4219-b41a-68e348f9f63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f4ae832fd84f91a3177001155777d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:41.305139 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8e5ab777-b07e-4219-b41a-68e348f9f63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f4ae832fd84f91a3177001155777d3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:41.311363 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1018/2036] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:16:40 2022] DELETE /identity/v3/users/73f4ae832fd84f91a3177001155777d3 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:16:41.711468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:41.713060 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:41.727270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11c007-8ebb-41ad-9838-24f3c2d71bb1 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:41.783623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6080803-f790-474c-81e3-ee046a328128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:41.784242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6080803-f790-474c-81e3-ee046a328128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:41.784515 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6080803-f790-474c-81e3-ee046a328128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:41.784782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6080803-f790-474c-81e3-ee046a328128 admin admin] PATH_INFO: `/v3/projects/0d9c8fd73a7c4277987d4b55ef1aaf39` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:41.785892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6080803-f790-474c-81e3-ee046a328128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9c8fd73a7c4277987d4b55ef1aaf39)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:41.787813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6080803-f790-474c-81e3-ee046a328128 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:41.882554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:41.899023 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f6080803-f790-474c-81e3-ee046a328128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9c8fd73a7c4277987d4b55ef1aaf39', 'request_id': 'req-f6080803-f790-474c-81e3-ee046a328128'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:41.979289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f6080803-f790-474c-81e3-ee046a328128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9c8fd73a7c4277987d4b55ef1aaf39', 'request_id': 'req-f6080803-f790-474c-81e3-ee046a328128'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:41.987452 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f6080803-f790-474c-81e3-ee046a328128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9c8fd73a7c4277987d4b55ef1aaf39', 'request_id': 'req-f6080803-f790-474c-81e3-ee046a328128'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:41.997828 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f6080803-f790-474c-81e3-ee046a328128 admin admin] The token cache is being invalidate because project 0d9c8fd73a7c4277987d4b55ef1aaf39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:16:41.998115 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f6080803-f790-474c-81e3-ee046a328128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:41.998764 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f6080803-f790-474c-81e3-ee046a328128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:42.000754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1019/2037] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:41 2022] DELETE /identity/v3/projects/0d9c8fd73a7c4277987d4b55ef1aaf39 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:42.005550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4ef8b-4445-4ec3-b4cc-af49e4412454 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:42.006026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4ef8b-4445-4ec3-b4cc-af49e4412454 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:42.006135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4ef8b-4445-4ec3-b4cc-af49e4412454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:42.026150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-70e4ef8b-4445-4ec3-b4cc-af49e4412454 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:42.027380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-70e4ef8b-4445-4ec3-b4cc-af49e4412454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:42.090056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1019/2038] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:42.099190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb033bdb-09b0-4add-88bf-2e93ef17c918 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:42.099504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb033bdb-09b0-4add-88bf-2e93ef17c918 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:42.099732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb033bdb-09b0-4add-88bf-2e93ef17c918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:42.121135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-cb033bdb-09b0-4add-88bf-2e93ef17c918 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:42.122425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-cb033bdb-09b0-4add-88bf-2e93ef17c918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:42.131720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1020/2039] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:42.135247 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4ef8b-4445-4ec3-b4cc-af49e4412454 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:42.145713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4ef8b-4445-4ec3-b4cc-af49e4412454 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:42.150263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f489344-e614-44b4-a043-d615fcaf8d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:42.150848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f489344-e614-44b4-a043-d615fcaf8d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:42.151123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f489344-e614-44b4-a043-d615fcaf8d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:42.151394 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f489344-e614-44b4-a043-d615fcaf8d9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:42.152037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f489344-e614-44b4-a043-d615fcaf8d9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:16:42.152340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f489344-e614-44b4-a043-d615fcaf8d9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:42.153970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f489344-e614-44b4-a043-d615fcaf8d9c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:42.166213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1020/2040] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:16:42.170637 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb033bdb-09b0-4add-88bf-2e93ef17c918 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:42.181133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb033bdb-09b0-4add-88bf-2e93ef17c918 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:42.186039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4fce4-a6f3-4a1f-bde5-364299d2e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:42.186642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4fce4-a6f3-4a1f-bde5-364299d2e667 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:42.186923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4fce4-a6f3-4a1f-bde5-364299d2e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:42.187797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4fce4-a6f3-4a1f-bde5-364299d2e667 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:42.188682 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4fce4-a6f3-4a1f-bde5-364299d2e667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:42.190612 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4fce4-a6f3-4a1f-bde5-364299d2e667 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:42.323609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1021/2041] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:16:42 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:16:42.328020 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f489344-e614-44b4-a043-d615fcaf8d9c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:42.338343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f489344-e614-44b4-a043-d615fcaf8d9c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:42.365524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:42.396903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb52ead-4328-4597-9785-6a5f3c9b137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:42.397546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb52ead-4328-4597-9785-6a5f3c9b137c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:42.397825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb52ead-4328-4597-9785-6a5f3c9b137c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:42.398092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb52ead-4328-4597-9785-6a5f3c9b137c admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:42.398732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb52ead-4328-4597-9785-6a5f3c9b137c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:42.400660 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb52ead-4328-4597-9785-6a5f3c9b137c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:42.477469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1021/2042] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:16:42 2022] POST /identity/v3/users => generated 284 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:16:42.481366 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4fce4-a6f3-4a1f-bde5-364299d2e667 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:42.492472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4fce4-a6f3-4a1f-bde5-364299d2e667 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:42.497226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cd632-027c-4f33-9a97-12e1937b8316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:42.497870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd632-027c-4f33-9a97-12e1937b8316 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:42.498145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd632-027c-4f33-9a97-12e1937b8316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:42.498413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5cd632-027c-4f33-9a97-12e1937b8316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:42.499070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cd632-027c-4f33-9a97-12e1937b8316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:42.501528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5cd632-027c-4f33-9a97-12e1937b8316 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:42.512405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1022/2043] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:42.517155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb52ead-4328-4597-9785-6a5f3c9b137c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:42.527280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb52ead-4328-4597-9785-6a5f3c9b137c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:42.533806 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcf1cb-25ff-496e-b95f-74a4ffe63f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:42.534435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcf1cb-25ff-496e-b95f-74a4ffe63f9f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:42.534715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcf1cb-25ff-496e-b95f-74a4ffe63f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:42.534982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcf1cb-25ff-496e-b95f-74a4ffe63f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:42.535618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcf1cb-25ff-496e-b95f-74a4ffe63f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:42.537203 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcf1cb-25ff-496e-b95f-74a4ffe63f9f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:42.548721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1022/2044] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:16:42.552745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cd632-027c-4f33-9a97-12e1937b8316 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:42.563511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5cd632-027c-4f33-9a97-12e1937b8316 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:42.568989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e01e4-debe-4eb6-9991-6fb4e3ad456e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:42.569678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e01e4-debe-4eb6-9991-6fb4e3ad456e admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:42.569952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e01e4-debe-4eb6-9991-6fb4e3ad456e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:42.570220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e01e4-debe-4eb6-9991-6fb4e3ad456e admin admin] PATH_INFO: `/v3/projects/1fc2ef14fe1347279119820d77f931ea/users/b5578e4ebd18479fbaf8ca64ad24b5f1/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:42.586393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e01e4-debe-4eb6-9991-6fb4e3ad456e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc2ef14fe1347279119820d77f931ea, user_id=b5578e4ebd18479fbaf8ca64ad24b5f1, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:42.589088 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e01e4-debe-4eb6-9991-6fb4e3ad456e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:42.694270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1023/2045] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:16:42 2022] PUT /identity/v3/projects/1fc2ef14fe1347279119820d77f931ea/users/b5578e4ebd18479fbaf8ca64ad24b5f1/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:42.705499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007fd07-2690-4d66-b834-87148804ed9f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:42.705789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007fd07-2690-4d66-b834-87148804ed9f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:42.706067 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007fd07-2690-4d66-b834-87148804ed9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:42.734259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d007fd07-2690-4d66-b834-87148804ed9f None None] MFA Rules not processed for user `b5578e4ebd18479fbaf8ca64ad24b5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:42.735827 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d007fd07-2690-4d66-b834-87148804ed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:42.806776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1023/2046] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:42.811334 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e01e4-debe-4eb6-9991-6fb4e3ad456e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:42.879020 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e01e4-debe-4eb6-9991-6fb4e3ad456e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:42.883638 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0133ab-0298-4de4-886f-13072173bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:42.884242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0133ab-0298-4de4-886f-13072173bbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:42.884520 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0133ab-0298-4de4-886f-13072173bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:42.884813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0133ab-0298-4de4-886f-13072173bbb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:42.885486 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0133ab-0298-4de4-886f-13072173bbb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:42.887409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0133ab-0298-4de4-886f-13072173bbb3 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:42.984622 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1024/2047] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:16:42 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:16:42.987508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007fd07-2690-4d66-b834-87148804ed9f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:42.998354 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007fd07-2690-4d66-b834-87148804ed9f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:43.056616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0b94c-0df3-44a2-9ac5-598bb4abdbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:43.057346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0b94c-0df3-44a2-9ac5-598bb4abdbea admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:43.057501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0b94c-0df3-44a2-9ac5-598bb4abdbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:43.057775 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0b94c-0df3-44a2-9ac5-598bb4abdbea admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:43.058514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0b94c-0df3-44a2-9ac5-598bb4abdbea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:43.060425 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0b94c-0df3-44a2-9ac5-598bb4abdbea admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:43.195969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1024/2048] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:16:42 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:16:43.211963 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0133ab-0298-4de4-886f-13072173bbb3 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:43.222355 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0133ab-0298-4de4-886f-13072173bbb3 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:43.226818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f701aa5-7ddc-4545-8524-d26a7ad25e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:43.227433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f701aa5-7ddc-4545-8524-d26a7ad25e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:43.227703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f701aa5-7ddc-4545-8524-d26a7ad25e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:43.227967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f701aa5-7ddc-4545-8524-d26a7ad25e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:43.228611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f701aa5-7ddc-4545-8524-d26a7ad25e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:43.230440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f701aa5-7ddc-4545-8524-d26a7ad25e1e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:43.242299 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1025/2049] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:43.246718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0b94c-0df3-44a2-9ac5-598bb4abdbea admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:43.257752 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0b94c-0df3-44a2-9ac5-598bb4abdbea admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:43.262328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88713e0e-aae4-4ce8-9da3-44b1e7a43ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:43.262997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88713e0e-aae4-4ce8-9da3-44b1e7a43ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:43.263347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88713e0e-aae4-4ce8-9da3-44b1e7a43ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:43.263624 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88713e0e-aae4-4ce8-9da3-44b1e7a43ad1 admin admin] PATH_INFO: `/v3/projects/dd1c4dced15a464ca6fd23ff6c51d2e7/users/f83d21d0574c4984842a691f0635e93d/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:43.280288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88713e0e-aae4-4ce8-9da3-44b1e7a43ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1c4dced15a464ca6fd23ff6c51d2e7, user_id=f83d21d0574c4984842a691f0635e93d, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:43.283734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88713e0e-aae4-4ce8-9da3-44b1e7a43ad1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:43.397084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1025/2050] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:16:43 2022] PUT /identity/v3/projects/dd1c4dced15a464ca6fd23ff6c51d2e7/users/f83d21d0574c4984842a691f0635e93d/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:43.401235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f701aa5-7ddc-4545-8524-d26a7ad25e1e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:43.412034 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f701aa5-7ddc-4545-8524-d26a7ad25e1e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:43.432659 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:43.467757 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbb48f-8b5d-476e-bc68-f8fc0152521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:43.468973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbb48f-8b5d-476e-bc68-f8fc0152521d admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:43.469165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbb48f-8b5d-476e-bc68-f8fc0152521d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:43.469468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbb48f-8b5d-476e-bc68-f8fc0152521d admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:43.470105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbb48f-8b5d-476e-bc68-f8fc0152521d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:43.471753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbb48f-8b5d-476e-bc68-f8fc0152521d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:43.481691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1026/2051] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:43.486621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88713e0e-aae4-4ce8-9da3-44b1e7a43ad1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:43.492062 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:43.496895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88713e0e-aae4-4ce8-9da3-44b1e7a43ad1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:43.501976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef7051-bd62-4dd9-b69c-894af5058f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:43.502628 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef7051-bd62-4dd9-b69c-894af5058f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:43.502909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef7051-bd62-4dd9-b69c-894af5058f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:43.503206 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef7051-bd62-4dd9-b69c-894af5058f7a admin admin] PATH_INFO: `/v3/projects/dd1c4dced15a464ca6fd23ff6c51d2e7/users/f83d21d0574c4984842a691f0635e93d/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:43.505217 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef7051-bd62-4dd9-b69c-894af5058f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1c4dced15a464ca6fd23ff6c51d2e7, user_id=f83d21d0574c4984842a691f0635e93d, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:43.508721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef7051-bd62-4dd9-b69c-894af5058f7a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:43.518327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1026/2052] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:16:43 2022] PUT /identity/v3/projects/dd1c4dced15a464ca6fd23ff6c51d2e7/users/f83d21d0574c4984842a691f0635e93d/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:43.528715 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff21a5-bbf9-49b6-99f6-4eb91c52d4a5 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:43.529001 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff21a5-bbf9-49b6-99f6-4eb91c52d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:43.529278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff21a5-bbf9-49b6-99f6-4eb91c52d4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:43.558367 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-1bff21a5-bbf9-49b6-99f6-4eb91c52d4a5 None None] MFA Rules not processed for user `f83d21d0574c4984842a691f0635e93d`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:43.559591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-1bff21a5-bbf9-49b6-99f6-4eb91c52d4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:43.627167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1027/2053] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:43.638595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef7051-bd62-4dd9-b69c-894af5058f7a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:43.642869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-55ef7051-bd62-4dd9-b69c-894af5058f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:43.700859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef7051-bd62-4dd9-b69c-894af5058f7a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:43.705193 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dde26a-a903-4eec-ae81-a96f53f19e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:43.705837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde26a-a903-4eec-ae81-a96f53f19e85 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:43.706114 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde26a-a903-4eec-ae81-a96f53f19e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:43.706384 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde26a-a903-4eec-ae81-a96f53f19e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:43.715207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dde26a-a903-4eec-ae81-a96f53f19e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:43.716619 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dde26a-a903-4eec-ae81-a96f53f19e85 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:43.726636 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1027/2054] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:43.853096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff21a5-bbf9-49b6-99f6-4eb91c52d4a5 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:43.854525 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-1bff21a5-bbf9-49b6-99f6-4eb91c52d4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:43.866569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff21a5-bbf9-49b6-99f6-4eb91c52d4a5 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:43.870380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb31018-de01-4726-b724-c2ff11bd3604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:43.870975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb31018-de01-4726-b724-c2ff11bd3604 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:43.871351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb31018-de01-4726-b724-c2ff11bd3604 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:43.871621 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb31018-de01-4726-b724-c2ff11bd3604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:43.930972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb31018-de01-4726-b724-c2ff11bd3604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:43.932417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb31018-de01-4726-b724-c2ff11bd3604 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:43.941881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1028/2055] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:45.519281 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94553697-06bb-4927-ba39-b976c86590f4 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:45.519787 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94553697-06bb-4927-ba39-b976c86590f4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:45.519899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94553697-06bb-4927-ba39-b976c86590f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:45.538665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-94553697-06bb-4927-ba39-b976c86590f4 None None] MFA Rules not processed for user `093519cbc8564b859c01a3a3ab1aae3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:45.539873 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-94553697-06bb-4927-ba39-b976c86590f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:45.593806 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1028/2056] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:49.383867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb31018-de01-4726-b724-c2ff11bd3604 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:49.431419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:49.448857 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb31018-de01-4726-b724-c2ff11bd3604 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:49.454625 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:49.454777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:49.455013 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:49.455289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] PATH_INFO: `/v3/users/b5578e4ebd18479fbaf8ca64ad24b5f1` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:49.456726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5578e4ebd18479fbaf8ca64ad24b5f1)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:49.458706 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:49.775496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5578e4ebd18479fbaf8ca64ad24b5f1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:49.776144 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5578e4ebd18479fbaf8ca64ad24b5f1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:49.789603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5578e4ebd18479fbaf8ca64ad24b5f1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:49.790269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5578e4ebd18479fbaf8ca64ad24b5f1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:49.876402 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5578e4ebd18479fbaf8ca64ad24b5f1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:49.897434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb994ad0-9c59-4e81-aadd-b54508cd3efc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:49.898579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb994ad0-9c59-4e81-aadd-b54508cd3efc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:49.898862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb994ad0-9c59-4e81-aadd-b54508cd3efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:49.925392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1029/2057] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:16:49 2022] DELETE /identity/v3/users/b5578e4ebd18479fbaf8ca64ad24b5f1 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:49.929632 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cb994ad0-9c59-4e81-aadd-b54508cd3efc None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:49.930857 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cb994ad0-9c59-4e81-aadd-b54508cd3efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:50.041699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1029/2058] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:16:50.052297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:50.054291 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:50.126552 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef9f59-2509-4be3-8f0a-02e2c932222c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:50.130167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696aa593-5db4-48a4-a734-1ed86a6b7cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:50.130785 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aa593-5db4-48a4-a734-1ed86a6b7cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:50.131065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aa593-5db4-48a4-a734-1ed86a6b7cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:50.131334 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696aa593-5db4-48a4-a734-1ed86a6b7cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:50.141178 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696aa593-5db4-48a4-a734-1ed86a6b7cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:50.144185 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696aa593-5db4-48a4-a734-1ed86a6b7cf7 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:50.153192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1030/2059] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:50.563608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb994ad0-9c59-4e81-aadd-b54508cd3efc None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:50.565146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cb994ad0-9c59-4e81-aadd-b54508cd3efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:50.585019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb994ad0-9c59-4e81-aadd-b54508cd3efc None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:50.590764 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:50.591623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:50.592011 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:50.592467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] PATH_INFO: `/v3/projects/1fc2ef14fe1347279119820d77f931ea` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:50.595591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc2ef14fe1347279119820d77f931ea)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:50.597698 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:50.706037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:50.718995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc2ef14fe1347279119820d77f931ea', 'request_id': 'req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:50.830526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc2ef14fe1347279119820d77f931ea', 'request_id': 'req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:50.839026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc2ef14fe1347279119820d77f931ea', 'request_id': 'req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:50.856223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] The token cache is being invalidate because project 1fc2ef14fe1347279119820d77f931ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:16:50.856663 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:50.857495 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:50.863321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1030/2060] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:50 2022] DELETE /identity/v3/projects/1fc2ef14fe1347279119820d77f931ea => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:50.869659 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696aa593-5db4-48a4-a734-1ed86a6b7cf7 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:50.875527 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696aa593-5db4-48a4-a734-1ed86a6b7cf7 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:50.942457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ced558-75db-42fc-b095-8a48fb1a4b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:50.943009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ced558-75db-42fc-b095-8a48fb1a4b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:50.943282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ced558-75db-42fc-b095-8a48fb1a4b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:50.943550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ced558-75db-42fc-b095-8a48fb1a4b56 admin admin] PATH_INFO: `/v3/users/f83d21d0574c4984842a691f0635e93d` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:50.944664 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ced558-75db-42fc-b095-8a48fb1a4b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83d21d0574c4984842a691f0635e93d)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:50.947317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ced558-75db-42fc-b095-8a48fb1a4b56 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:50.953462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:51.161643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-65ced558-75db-42fc-b095-8a48fb1a4b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83d21d0574c4984842a691f0635e93d'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:51.162555 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-65ced558-75db-42fc-b095-8a48fb1a4b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83d21d0574c4984842a691f0635e93d'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:51.178983 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-65ced558-75db-42fc-b095-8a48fb1a4b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83d21d0574c4984842a691f0635e93d'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:51.179702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-65ced558-75db-42fc-b095-8a48fb1a4b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83d21d0574c4984842a691f0635e93d'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:51.274102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-65ced558-75db-42fc-b095-8a48fb1a4b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83d21d0574c4984842a691f0635e93d'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:51.288034 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1031/2061] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:16:50 2022] DELETE /identity/v3/users/f83d21d0574c4984842a691f0635e93d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:16:51.798677 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:51.800375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:51.816453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936ba37-cc18-4597-b2c4-66dfcbf2ceec admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:51.876184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57502928-879c-4051-9c57-be12301323c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:51.876781 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57502928-879c-4051-9c57-be12301323c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:51.877059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57502928-879c-4051-9c57-be12301323c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:51.877354 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57502928-879c-4051-9c57-be12301323c9 admin admin] PATH_INFO: `/v3/projects/dd1c4dced15a464ca6fd23ff6c51d2e7` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:51.878451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57502928-879c-4051-9c57-be12301323c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1c4dced15a464ca6fd23ff6c51d2e7)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:51.880427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57502928-879c-4051-9c57-be12301323c9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:52.002686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-57502928-879c-4051-9c57-be12301323c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1c4dced15a464ca6fd23ff6c51d2e7', 'request_id': 'req-57502928-879c-4051-9c57-be12301323c9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:52.081952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-57502928-879c-4051-9c57-be12301323c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1c4dced15a464ca6fd23ff6c51d2e7', 'request_id': 'req-57502928-879c-4051-9c57-be12301323c9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:52.088773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-57502928-879c-4051-9c57-be12301323c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1c4dced15a464ca6fd23ff6c51d2e7', 'request_id': 'req-57502928-879c-4051-9c57-be12301323c9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:52.100025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-57502928-879c-4051-9c57-be12301323c9 admin admin] The token cache is being invalidate because project dd1c4dced15a464ca6fd23ff6c51d2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:16:52.100314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-57502928-879c-4051-9c57-be12301323c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:52.100943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-57502928-879c-4051-9c57-be12301323c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:52.102493 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1031/2062] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:51 2022] DELETE /identity/v3/projects/dd1c4dced15a464ca6fd23ff6c51d2e7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:52.107331 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9ca95-2bf2-4639-bcad-6654123397f9 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:52.107793 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9ca95-2bf2-4639-bcad-6654123397f9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:52.107886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9ca95-2bf2-4639-bcad-6654123397f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:52.128246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-4ef9ca95-2bf2-4639-bcad-6654123397f9 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:52.129497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-4ef9ca95-2bf2-4639-bcad-6654123397f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:52.191748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1032/2063] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:52.199572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9405bcd-39fb-4a40-bb5d-10d66467f6aa None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:52.199860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9405bcd-39fb-4a40-bb5d-10d66467f6aa None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:52.200138 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9405bcd-39fb-4a40-bb5d-10d66467f6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:52.220848 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b9405bcd-39fb-4a40-bb5d-10d66467f6aa None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:52.222204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b9405bcd-39fb-4a40-bb5d-10d66467f6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:52.230102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1032/2064] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:52.234439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9ca95-2bf2-4639-bcad-6654123397f9 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:52.244436 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9ca95-2bf2-4639-bcad-6654123397f9 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:52.249076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3b3ed-9f1c-4163-bb9b-1725fe1ab037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:52.249702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3b3ed-9f1c-4163-bb9b-1725fe1ab037 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:52.249979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3b3ed-9f1c-4163-bb9b-1725fe1ab037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:52.250246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3b3ed-9f1c-4163-bb9b-1725fe1ab037 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:52.250888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3b3ed-9f1c-4163-bb9b-1725fe1ab037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:16:52.251189 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3b3ed-9f1c-4163-bb9b-1725fe1ab037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:52.253452 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3b3ed-9f1c-4163-bb9b-1725fe1ab037 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:52.264890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1033/2065] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:16:52.270059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9405bcd-39fb-4a40-bb5d-10d66467f6aa None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:52.279596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9405bcd-39fb-4a40-bb5d-10d66467f6aa None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:52.284977 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a981e4-6134-4a10-9923-493d7c561f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:52.285646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a981e4-6134-4a10-9923-493d7c561f1a admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:52.287676 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a981e4-6134-4a10-9923-493d7c561f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:52.287676 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a981e4-6134-4a10-9923-493d7c561f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:52.287676 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a981e4-6134-4a10-9923-493d7c561f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:52.288690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a981e4-6134-4a10-9923-493d7c561f1a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:52.386404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1033/2066] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:16:52 2022] POST /identity/v3/projects => generated 389 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:16:52.390267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3b3ed-9f1c-4163-bb9b-1725fe1ab037 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:52.400965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3b3ed-9f1c-4163-bb9b-1725fe1ab037 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:52.461881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4192884-4c54-4e70-8fc9-356fa555987d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:52.462489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4192884-4c54-4e70-8fc9-356fa555987d admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:52.462926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4192884-4c54-4e70-8fc9-356fa555987d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:52.463201 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4192884-4c54-4e70-8fc9-356fa555987d admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:52.463864 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4192884-4c54-4e70-8fc9-356fa555987d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:52.465845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4192884-4c54-4e70-8fc9-356fa555987d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:52.573860 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1034/2067] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:16:52 2022] POST /identity/v3/users => generated 295 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:16:52.577942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a981e4-6134-4a10-9923-493d7c561f1a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:52.587919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a981e4-6134-4a10-9923-493d7c561f1a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:52.592360 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27416db5-8aec-4f61-9e0b-7108fc88b68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:52.592936 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27416db5-8aec-4f61-9e0b-7108fc88b68c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:52.593207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27416db5-8aec-4f61-9e0b-7108fc88b68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:52.593498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27416db5-8aec-4f61-9e0b-7108fc88b68c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:52.594125 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27416db5-8aec-4f61-9e0b-7108fc88b68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:52.595692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27416db5-8aec-4f61-9e0b-7108fc88b68c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:52.605824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1034/2068] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:52.609484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4192884-4c54-4e70-8fc9-356fa555987d admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:52.616267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:52.621841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4192884-4c54-4e70-8fc9-356fa555987d admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:52.626425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c427aa3-1974-453a-bc52-e964cc4653cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:52.627709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c427aa3-1974-453a-bc52-e964cc4653cf admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:52.627709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c427aa3-1974-453a-bc52-e964cc4653cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:52.627709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c427aa3-1974-453a-bc52-e964cc4653cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:52.628885 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c427aa3-1974-453a-bc52-e964cc4653cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:52.630501 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c427aa3-1974-453a-bc52-e964cc4653cf admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:52.641181 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1035/2069] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:52.645641 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27416db5-8aec-4f61-9e0b-7108fc88b68c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:52.655434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27416db5-8aec-4f61-9e0b-7108fc88b68c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:52.659981 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a73cf4-6277-4d82-953b-f3212303f76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:52.660604 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a73cf4-6277-4d82-953b-f3212303f76f admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:52.660880 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a73cf4-6277-4d82-953b-f3212303f76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:52.662352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a73cf4-6277-4d82-953b-f3212303f76f admin admin] PATH_INFO: `/v3/projects/6d3d13cfb1774396bb584584bb7475f3/users/abc9c00fa7774708af114bca65b635e4/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:52.669431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:52.676117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a73cf4-6277-4d82-953b-f3212303f76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3d13cfb1774396bb584584bb7475f3, user_id=abc9c00fa7774708af114bca65b635e4, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:52.679045 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a73cf4-6277-4d82-953b-f3212303f76f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:52.761767 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1035/2070] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:16:52 2022] PUT /identity/v3/projects/6d3d13cfb1774396bb584584bb7475f3/users/abc9c00fa7774708af114bca65b635e4/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:52.772369 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b671521-f42d-4d90-a460-48f5cb551684 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:52.772652 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b671521-f42d-4d90-a460-48f5cb551684 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:52.772925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b671521-f42d-4d90-a460-48f5cb551684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:52.800301 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-9b671521-f42d-4d90-a460-48f5cb551684 None None] MFA Rules not processed for user `abc9c00fa7774708af114bca65b635e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:52.801645 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9b671521-f42d-4d90-a460-48f5cb551684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:52.866805 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1036/2071] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:52.871428 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a73cf4-6277-4d82-953b-f3212303f76f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:52.933443 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a73cf4-6277-4d82-953b-f3212303f76f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:52.937983 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ef17d-4fe0-493f-b3f7-2de97dd1693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:52.938570 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ef17d-4fe0-493f-b3f7-2de97dd1693e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:52.938845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ef17d-4fe0-493f-b3f7-2de97dd1693e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:52.939113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ef17d-4fe0-493f-b3f7-2de97dd1693e admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:52.939742 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ef17d-4fe0-493f-b3f7-2de97dd1693e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:52.941850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ef17d-4fe0-493f-b3f7-2de97dd1693e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:53.026288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1036/2072] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:16:52 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:16:53.030381 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b671521-f42d-4d90-a460-48f5cb551684 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:53.041808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b671521-f42d-4d90-a460-48f5cb551684 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:53.098282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26c651-92a3-46ce-9d76-296e8c74cd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:53.098884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26c651-92a3-46ce-9d76-296e8c74cd9d admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:53.099164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26c651-92a3-46ce-9d76-296e8c74cd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:53.099431 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26c651-92a3-46ce-9d76-296e8c74cd9d admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:53.100065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26c651-92a3-46ce-9d76-296e8c74cd9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:53.102019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26c651-92a3-46ce-9d76-296e8c74cd9d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:53.189949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1037/2073] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:16:53 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:16:53.193884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ef17d-4fe0-493f-b3f7-2de97dd1693e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:53.204183 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ef17d-4fe0-493f-b3f7-2de97dd1693e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:53.208856 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2479945-1c79-49b0-8ada-1b84cd824017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:53.209485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2479945-1c79-49b0-8ada-1b84cd824017 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:53.209762 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2479945-1c79-49b0-8ada-1b84cd824017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:53.210035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2479945-1c79-49b0-8ada-1b84cd824017 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:53.210673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2479945-1c79-49b0-8ada-1b84cd824017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:53.212299 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2479945-1c79-49b0-8ada-1b84cd824017 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:53.223270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1037/2074] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:53.227301 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26c651-92a3-46ce-9d76-296e8c74cd9d admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:53.238138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26c651-92a3-46ce-9d76-296e8c74cd9d admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:53.242764 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deadd21-957d-4670-b76e-7a4a3f834724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:53.243398 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deadd21-957d-4670-b76e-7a4a3f834724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:53.243676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deadd21-957d-4670-b76e-7a4a3f834724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:53.244100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deadd21-957d-4670-b76e-7a4a3f834724 admin admin] PATH_INFO: `/v3/projects/a1c11a9b720d4d9ca946054ababe253a/users/0c695787d14b43b2a5ab284abdf8f54a/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:53.259130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deadd21-957d-4670-b76e-7a4a3f834724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c11a9b720d4d9ca946054ababe253a, user_id=0c695787d14b43b2a5ab284abdf8f54a, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:53.261806 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deadd21-957d-4670-b76e-7a4a3f834724 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:53.351556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1038/2075] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:16:53 2022] PUT /identity/v3/projects/a1c11a9b720d4d9ca946054ababe253a/users/0c695787d14b43b2a5ab284abdf8f54a/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:53.355535 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2479945-1c79-49b0-8ada-1b84cd824017 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:53.365796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2479945-1c79-49b0-8ada-1b84cd824017 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:53.420956 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc2cd9-6744-4fdc-aabb-7f2828f16672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:53.421574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2cd9-6744-4fdc-aabb-7f2828f16672 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:53.421852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2cd9-6744-4fdc-aabb-7f2828f16672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:53.422123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc2cd9-6744-4fdc-aabb-7f2828f16672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:53.422786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc2cd9-6744-4fdc-aabb-7f2828f16672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:53.424360 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc2cd9-6744-4fdc-aabb-7f2828f16672 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:53.434176 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1038/2076] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:53.438306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deadd21-957d-4670-b76e-7a4a3f834724 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:53.448521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deadd21-957d-4670-b76e-7a4a3f834724 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:53.452953 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125ac98-1f91-471d-bfe3-fb08cc62d851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:53.453614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125ac98-1f91-471d-bfe3-fb08cc62d851 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:53.453889 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125ac98-1f91-471d-bfe3-fb08cc62d851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:53.454155 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125ac98-1f91-471d-bfe3-fb08cc62d851 admin admin] PATH_INFO: `/v3/projects/a1c11a9b720d4d9ca946054ababe253a/users/0c695787d14b43b2a5ab284abdf8f54a/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:53.456575 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125ac98-1f91-471d-bfe3-fb08cc62d851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c11a9b720d4d9ca946054ababe253a, user_id=0c695787d14b43b2a5ab284abdf8f54a, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:53.459199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125ac98-1f91-471d-bfe3-fb08cc62d851 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:53.469037 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1039/2077] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:16:53 2022] PUT /identity/v3/projects/a1c11a9b720d4d9ca946054ababe253a/users/0c695787d14b43b2a5ab284abdf8f54a/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:53.480577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d301972-f549-4788-9faf-f95b5e90c4a8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:53.480860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d301972-f549-4788-9faf-f95b5e90c4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:53.481134 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d301972-f549-4788-9faf-f95b5e90c4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:53.509195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2d301972-f549-4788-9faf-f95b5e90c4a8 None None] MFA Rules not processed for user `0c695787d14b43b2a5ab284abdf8f54a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:53.510443 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2d301972-f549-4788-9faf-f95b5e90c4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:53.563309 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:53.597751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1039/2078] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:53.604562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125ac98-1f91-471d-bfe3-fb08cc62d851 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:53.607142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3125ac98-1f91-471d-bfe3-fb08cc62d851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:53.658044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:53.685029 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125ac98-1f91-471d-bfe3-fb08cc62d851 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:53.689025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f93b6-ff50-424e-855f-e286ed32851e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:53.689697 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f93b6-ff50-424e-855f-e286ed32851e service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:53.689973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f93b6-ff50-424e-855f-e286ed32851e service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:53.690829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f93b6-ff50-424e-855f-e286ed32851e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:53.702627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f93b6-ff50-424e-855f-e286ed32851e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:53.704656 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f93b6-ff50-424e-855f-e286ed32851e service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:53.719740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1040/2079] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:53.869313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d301972-f549-4788-9faf-f95b5e90c4a8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:53.932945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d301972-f549-4788-9faf-f95b5e90c4a8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:53.937919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:53.938545 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:53.938822 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:53.939100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] PATH_INFO: `/v3/users/abc9c00fa7774708af114bca65b635e4` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:53.940778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc9c00fa7774708af114bca65b635e4)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:53.942845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:54.319972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc9c00fa7774708af114bca65b635e4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:54.320763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc9c00fa7774708af114bca65b635e4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:54.328282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc9c00fa7774708af114bca65b635e4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:54.407926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc9c00fa7774708af114bca65b635e4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:54.422223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc9c00fa7774708af114bca65b635e4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:54.428273 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1040/2080] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:16:53 2022] DELETE /identity/v3/users/abc9c00fa7774708af114bca65b635e4 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:54.433063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65695b95-3e0d-4dcd-805b-28e2807c0334 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:54.433597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65695b95-3e0d-4dcd-805b-28e2807c0334 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:54.433700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65695b95-3e0d-4dcd-805b-28e2807c0334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:54.454215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-65695b95-3e0d-4dcd-805b-28e2807c0334 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:54.455402 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-65695b95-3e0d-4dcd-805b-28e2807c0334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:54.514900 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1041/2081] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:54.525398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:54.526881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:54.583957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ab229-bc29-4865-ac01-f8bf847ccbd0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:54.587522 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fc5e4-d2df-4513-8818-885f6db5f573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:54.588118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fc5e4-d2df-4513-8818-885f6db5f573 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:54.588396 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fc5e4-d2df-4513-8818-885f6db5f573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:54.588669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fc5e4-d2df-4513-8818-885f6db5f573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:54.597806 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fc5e4-d2df-4513-8818-885f6db5f573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:54.599229 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fc5e4-d2df-4513-8818-885f6db5f573 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:54.608822 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1041/2082] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:55.020205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65695b95-3e0d-4dcd-805b-28e2807c0334 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:55.021774 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-65695b95-3e0d-4dcd-805b-28e2807c0334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:55.036584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65695b95-3e0d-4dcd-805b-28e2807c0334 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:55.041498 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:55.045354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:55.045354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:55.045354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] PATH_INFO: `/v3/projects/6d3d13cfb1774396bb584584bb7475f3` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:55.045354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3d13cfb1774396bb584584bb7475f3)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:55.045923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:55.150656 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3d13cfb1774396bb584584bb7475f3', 'request_id': 'req-bfae5e99-93ca-4c43-be44-0d44845093ed'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:55.230275 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3d13cfb1774396bb584584bb7475f3', 'request_id': 'req-bfae5e99-93ca-4c43-be44-0d44845093ed'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:55.237036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3d13cfb1774396bb584584bb7475f3', 'request_id': 'req-bfae5e99-93ca-4c43-be44-0d44845093ed'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:55.248337 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] The token cache is being invalidate because project 6d3d13cfb1774396bb584584bb7475f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:16:55.248650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:55.249278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:55.250822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1042/2083] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:55 2022] DELETE /identity/v3/projects/6d3d13cfb1774396bb584584bb7475f3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:55.255012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fc5e4-d2df-4513-8818-885f6db5f573 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:55.261077 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:55.264661 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fc5e4-d2df-4513-8818-885f6db5f573 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:55.321775 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ead06-cfe4-4a64-9afa-89e64bf5162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:55.322408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ead06-cfe4-4a64-9afa-89e64bf5162b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:55.322685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ead06-cfe4-4a64-9afa-89e64bf5162b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:55.322961 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ead06-cfe4-4a64-9afa-89e64bf5162b admin admin] PATH_INFO: `/v3/users/0c695787d14b43b2a5ab284abdf8f54a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:55.324098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ead06-cfe4-4a64-9afa-89e64bf5162b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c695787d14b43b2a5ab284abdf8f54a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:55.326105 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ead06-cfe4-4a64-9afa-89e64bf5162b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:55.558978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-af5ead06-cfe4-4a64-9afa-89e64bf5162b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c695787d14b43b2a5ab284abdf8f54a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:55.559629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-af5ead06-cfe4-4a64-9afa-89e64bf5162b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c695787d14b43b2a5ab284abdf8f54a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:55.566795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-af5ead06-cfe4-4a64-9afa-89e64bf5162b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c695787d14b43b2a5ab284abdf8f54a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:55.653422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-af5ead06-cfe4-4a64-9afa-89e64bf5162b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c695787d14b43b2a5ab284abdf8f54a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:55.667688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-af5ead06-cfe4-4a64-9afa-89e64bf5162b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c695787d14b43b2a5ab284abdf8f54a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:55.673634 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1042/2084] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:16:55 2022] DELETE /identity/v3/users/0c695787d14b43b2a5ab284abdf8f54a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:56.118069 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:56.119651 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:56.134850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae5e99-93ca-4c43-be44-0d44845093ed admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:56.197949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:56.198663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:56.198932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:56.199196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295 admin admin] PATH_INFO: `/v3/projects/a1c11a9b720d4d9ca946054ababe253a` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:56.200297 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c11a9b720d4d9ca946054ababe253a)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:56.202287 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:56.203789 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:56.357008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c11a9b720d4d9ca946054ababe253a', 'request_id': 'req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:56.498581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c11a9b720d4d9ca946054ababe253a', 'request_id': 'req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:56.505693 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c11a9b720d4d9ca946054ababe253a', 'request_id': 'req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:56.515962 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295 admin admin] The token cache is being invalidate because project a1c11a9b720d4d9ca946054ababe253a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:16:56.516246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:56.516868 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-cbfbbecf-edc3-4182-8b2e-ad60f5a34295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:56.518359 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1043/2085] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:16:56 2022] DELETE /identity/v3/projects/a1c11a9b720d4d9ca946054ababe253a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:56.523959 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e344a-7fc0-4525-8383-4f9e1b5ebe00 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:56.524460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e344a-7fc0-4525-8383-4f9e1b5ebe00 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:56.524568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e344a-7fc0-4525-8383-4f9e1b5ebe00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:56.546096 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-391e344a-7fc0-4525-8383-4f9e1b5ebe00 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:56.547295 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-391e344a-7fc0-4525-8383-4f9e1b5ebe00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:56.605754 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1043/2086] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:56.613675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04977e-b71a-49d6-9953-4a47e4eed174 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:56.613982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04977e-b71a-49d6-9953-4a47e4eed174 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:56.614245 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04977e-b71a-49d6-9953-4a47e4eed174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:56.634938 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-4c04977e-b71a-49d6-9953-4a47e4eed174 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:56.636134 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-4c04977e-b71a-49d6-9953-4a47e4eed174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:56.644661 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1044/2087] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:56.648740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e344a-7fc0-4525-8383-4f9e1b5ebe00 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:56.658360 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e344a-7fc0-4525-8383-4f9e1b5ebe00 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:56.663144 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326caa9-1f43-4723-9d4f-dc72ec260f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:56.663733 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326caa9-1f43-4723-9d4f-dc72ec260f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:56.664015 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326caa9-1f43-4723-9d4f-dc72ec260f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:56.664285 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326caa9-1f43-4723-9d4f-dc72ec260f18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:56.664955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326caa9-1f43-4723-9d4f-dc72ec260f18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:16:56.665255 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326caa9-1f43-4723-9d4f-dc72ec260f18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:56.666860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326caa9-1f43-4723-9d4f-dc72ec260f18 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:56.678219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1044/2088] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:16:56.682725 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04977e-b71a-49d6-9953-4a47e4eed174 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:56.692395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04977e-b71a-49d6-9953-4a47e4eed174 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:56.696952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f35297-c413-447e-bd85-e57ed2f6ba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:56.697570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f35297-c413-447e-bd85-e57ed2f6ba96 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:56.697851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f35297-c413-447e-bd85-e57ed2f6ba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:56.698119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f35297-c413-447e-bd85-e57ed2f6ba96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:56.698751 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f35297-c413-447e-bd85-e57ed2f6ba96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:56.700621 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f35297-c413-447e-bd85-e57ed2f6ba96 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:56.796432 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1045/2089] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:16:56 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:16:56.800699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326caa9-1f43-4723-9d4f-dc72ec260f18 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:56.811061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326caa9-1f43-4723-9d4f-dc72ec260f18 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:56.819660 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:56.867431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6203d-28b2-488e-948b-73ec06e0d22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:56.868021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6203d-28b2-488e-948b-73ec06e0d22a admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:56.868294 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6203d-28b2-488e-948b-73ec06e0d22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:56.868561 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6203d-28b2-488e-948b-73ec06e0d22a admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:56.869178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6203d-28b2-488e-948b-73ec06e0d22a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:56.871124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6203d-28b2-488e-948b-73ec06e0d22a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:56.979579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1045/2090] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:16:56 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:16:56.983662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f35297-c413-447e-bd85-e57ed2f6ba96 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:56.994176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f35297-c413-447e-bd85-e57ed2f6ba96 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:56.998776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646a897-8a6f-48d1-b692-0999a4b7a6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:56.999368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646a897-8a6f-48d1-b692-0999a4b7a6be admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:56.999671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646a897-8a6f-48d1-b692-0999a4b7a6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:56.999955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646a897-8a6f-48d1-b692-0999a4b7a6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:57.000607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646a897-8a6f-48d1-b692-0999a4b7a6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:57.002235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646a897-8a6f-48d1-b692-0999a4b7a6be admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:57.012673 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1046/2091] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:57.020411 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6203d-28b2-488e-948b-73ec06e0d22a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:57.030331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6203d-28b2-488e-948b-73ec06e0d22a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:57.035191 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142334dc-c4a6-4ad7-86ec-390945edb9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:57.035771 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142334dc-c4a6-4ad7-86ec-390945edb9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:57.036045 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142334dc-c4a6-4ad7-86ec-390945edb9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:57.036340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142334dc-c4a6-4ad7-86ec-390945edb9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:57.036975 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142334dc-c4a6-4ad7-86ec-390945edb9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:57.038581 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142334dc-c4a6-4ad7-86ec-390945edb9b6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:57.051168 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1046/2092] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:16:57.054443 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646a897-8a6f-48d1-b692-0999a4b7a6be admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:57.064591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646a897-8a6f-48d1-b692-0999a4b7a6be admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:57.070133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa379e03-5a74-4e3b-a297-74ffdcd4396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:57.070774 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa379e03-5a74-4e3b-a297-74ffdcd4396c admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:57.071051 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa379e03-5a74-4e3b-a297-74ffdcd4396c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:57.071323 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa379e03-5a74-4e3b-a297-74ffdcd4396c admin admin] PATH_INFO: `/v3/projects/a5b28a7709c5465a8d561c707de367a8/users/bb0e1e168a64433c9354d6c3fd232490/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:57.085866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa379e03-5a74-4e3b-a297-74ffdcd4396c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b28a7709c5465a8d561c707de367a8, user_id=bb0e1e168a64433c9354d6c3fd232490, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:57.088499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa379e03-5a74-4e3b-a297-74ffdcd4396c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:57.173100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1047/2093] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:16:57 2022] PUT /identity/v3/projects/a5b28a7709c5465a8d561c707de367a8/users/bb0e1e168a64433c9354d6c3fd232490/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:57.184192 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815b9f-9b68-47f1-9464-79f3cebe24a8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:57.184469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815b9f-9b68-47f1-9464-79f3cebe24a8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:57.184786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815b9f-9b68-47f1-9464-79f3cebe24a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:57.212205 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9c815b9f-9b68-47f1-9464-79f3cebe24a8 None None] MFA Rules not processed for user `bb0e1e168a64433c9354d6c3fd232490`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:57.213439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9c815b9f-9b68-47f1-9464-79f3cebe24a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:57.281016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1047/2094] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:57.283188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa379e03-5a74-4e3b-a297-74ffdcd4396c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:57.381323 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa379e03-5a74-4e3b-a297-74ffdcd4396c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:57.387490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098045e-af12-4898-88a3-9dff79c07a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:57.389039 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098045e-af12-4898-88a3-9dff79c07a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:57.389271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098045e-af12-4898-88a3-9dff79c07a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:57.393973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098045e-af12-4898-88a3-9dff79c07a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:57.393973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098045e-af12-4898-88a3-9dff79c07a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:57.393973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098045e-af12-4898-88a3-9dff79c07a86 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:57.500982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1048/2095] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:16:57 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:16:57.505147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c815b9f-9b68-47f1-9464-79f3cebe24a8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:57.518677 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c815b9f-9b68-47f1-9464-79f3cebe24a8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:57.576500 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a04cc-a83c-4e3e-b736-7c901aa0c395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:57.577192 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a04cc-a83c-4e3e-b736-7c901aa0c395 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:57.577415 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a04cc-a83c-4e3e-b736-7c901aa0c395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:57.577693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a04cc-a83c-4e3e-b736-7c901aa0c395 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:57.578321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a04cc-a83c-4e3e-b736-7c901aa0c395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:57.580243 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a04cc-a83c-4e3e-b736-7c901aa0c395 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:57.698668 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1048/2096] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:16:57 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:16:57.702294 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098045e-af12-4898-88a3-9dff79c07a86 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:57.713424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098045e-af12-4898-88a3-9dff79c07a86 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:57.718468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfef37-249d-483c-b9eb-fe8f7419aa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:57.719068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfef37-249d-483c-b9eb-fe8f7419aa65 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:57.719631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfef37-249d-483c-b9eb-fe8f7419aa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:57.719759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfef37-249d-483c-b9eb-fe8f7419aa65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:57.720413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfef37-249d-483c-b9eb-fe8f7419aa65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:57.722570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfef37-249d-483c-b9eb-fe8f7419aa65 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:57.728403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:57.734259 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1049/2097] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:57.739083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a04cc-a83c-4e3e-b736-7c901aa0c395 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:57.749155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a04cc-a83c-4e3e-b736-7c901aa0c395 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:57.753715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532b4e3-93dd-416a-ae7e-9cc2dbe33c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:57.754352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532b4e3-93dd-416a-ae7e-9cc2dbe33c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:57.754629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532b4e3-93dd-416a-ae7e-9cc2dbe33c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:57.754898 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532b4e3-93dd-416a-ae7e-9cc2dbe33c1f admin admin] PATH_INFO: `/v3/projects/06f3c1357b7b4159a06579197807af3e/users/dd4d97b4cc2f4dd1b4eb6780184a4751/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:57.758000 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:57.770348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532b4e3-93dd-416a-ae7e-9cc2dbe33c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f3c1357b7b4159a06579197807af3e, user_id=dd4d97b4cc2f4dd1b4eb6780184a4751, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:57.773078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532b4e3-93dd-416a-ae7e-9cc2dbe33c1f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:57.887895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1049/2098] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:16:57 2022] PUT /identity/v3/projects/06f3c1357b7b4159a06579197807af3e/users/dd4d97b4cc2f4dd1b4eb6780184a4751/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:57.892022 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfef37-249d-483c-b9eb-fe8f7419aa65 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:57.902671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfef37-249d-483c-b9eb-fe8f7419aa65 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:57.958593 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c541d4-17a1-4720-a5bd-76e126353936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:57.959116 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c541d4-17a1-4720-a5bd-76e126353936 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:57.959391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c541d4-17a1-4720-a5bd-76e126353936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:57.959772 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c541d4-17a1-4720-a5bd-76e126353936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:57.960408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c541d4-17a1-4720-a5bd-76e126353936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:57.962046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c541d4-17a1-4720-a5bd-76e126353936 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:57.971959 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1050/2099] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:16:57.976851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532b4e3-93dd-416a-ae7e-9cc2dbe33c1f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:57.987252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532b4e3-93dd-416a-ae7e-9cc2dbe33c1f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:57.991851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db03e7-e450-4137-a4fb-569bdc051ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:57.992483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db03e7-e450-4137-a4fb-569bdc051ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:57.992857 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db03e7-e450-4137-a4fb-569bdc051ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:57.993082 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db03e7-e450-4137-a4fb-569bdc051ed0 admin admin] PATH_INFO: `/v3/projects/06f3c1357b7b4159a06579197807af3e/users/dd4d97b4cc2f4dd1b4eb6780184a4751/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:57.994887 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db03e7-e450-4137-a4fb-569bdc051ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f3c1357b7b4159a06579197807af3e, user_id=dd4d97b4cc2f4dd1b4eb6780184a4751, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:57.997519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db03e7-e450-4137-a4fb-569bdc051ed0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:58.007508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1050/2100] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:16:57 2022] PUT /identity/v3/projects/06f3c1357b7b4159a06579197807af3e/users/dd4d97b4cc2f4dd1b4eb6780184a4751/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:58.018650 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae589e-77a0-45f5-b6d5-a09550634f3a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:58.022799 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae589e-77a0-45f5-b6d5-a09550634f3a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:58.022799 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae589e-77a0-45f5-b6d5-a09550634f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:58.047415 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-deae589e-77a0-45f5-b6d5-a09550634f3a None None] MFA Rules not processed for user `dd4d97b4cc2f4dd1b4eb6780184a4751`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:58.051459 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-deae589e-77a0-45f5-b6d5-a09550634f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:58.115993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1051/2101] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:58.127585 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db03e7-e450-4137-a4fb-569bdc051ed0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:58.129880 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c3db03e7-e450-4137-a4fb-569bdc051ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:58.185903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db03e7-e450-4137-a4fb-569bdc051ed0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:58.189504 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e9411-85ae-4233-a99c-1bd1e54be95f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:58.190094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e9411-85ae-4233-a99c-1bd1e54be95f service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:58.190368 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e9411-85ae-4233-a99c-1bd1e54be95f service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:58.190633 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e9411-85ae-4233-a99c-1bd1e54be95f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:58.200167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e9411-85ae-4233-a99c-1bd1e54be95f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:58.201598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e9411-85ae-4233-a99c-1bd1e54be95f service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:58.211386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1051/2102] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:58.766194 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae589e-77a0-45f5-b6d5-a09550634f3a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:58.837409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae589e-77a0-45f5-b6d5-a09550634f3a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:58.841922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:58.842545 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:58.842818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:58.843083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] PATH_INFO: `/v3/users/bb0e1e168a64433c9354d6c3fd232490` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:58.844215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0e1e168a64433c9354d6c3fd232490)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:58.846149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:58.869461 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:59.079880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0e1e168a64433c9354d6c3fd232490'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:59.080556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0e1e168a64433c9354d6c3fd232490'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:59.099031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0e1e168a64433c9354d6c3fd232490'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:59.099746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0e1e168a64433c9354d6c3fd232490'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:59.161611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0e1e168a64433c9354d6c3fd232490'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:16:59.177730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1052/2103] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:16:58 2022] DELETE /identity/v3/users/bb0e1e168a64433c9354d6c3fd232490 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:16:59.182493 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e05e16-1038-4b29-9ad9-8e5de938c8ac None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:59.182997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e05e16-1038-4b29-9ad9-8e5de938c8ac None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:59.183157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e05e16-1038-4b29-9ad9-8e5de938c8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:59.202201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a7e05e16-1038-4b29-9ad9-8e5de938c8ac None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:16:59.203393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a7e05e16-1038-4b29-9ad9-8e5de938c8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:59.262893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1052/2104] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:16:59.273529 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:16:59.274956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:16:59.334075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de399393-c6df-4303-a7d2-6bf1ece99d6c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:16:59.337701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e74abd-2567-4498-a159-78b8ce08a89d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:16:59.338306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e74abd-2567-4498-a159-78b8ce08a89d service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:16:59.338581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e74abd-2567-4498-a159-78b8ce08a89d service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:16:59.338851 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e74abd-2567-4498-a159-78b8ce08a89d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:16:59.349838 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e74abd-2567-4498-a159-78b8ce08a89d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:16:59.351312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e74abd-2567-4498-a159-78b8ce08a89d service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:16:59.361562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1053/2105] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:17:00.049338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e05e16-1038-4b29-9ad9-8e5de938c8ac None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:00.051456 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a7e05e16-1038-4b29-9ad9-8e5de938c8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:00.066384 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e05e16-1038-4b29-9ad9-8e5de938c8ac None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:00.072195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:00.072846 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:00.073121 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:00.073424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] PATH_INFO: `/v3/projects/a5b28a7709c5465a8d561c707de367a8` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:00.074574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b28a7709c5465a8d561c707de367a8)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:00.076470 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:00.212121 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b28a7709c5465a8d561c707de367a8', 'request_id': 'req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:00.340016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b28a7709c5465a8d561c707de367a8', 'request_id': 'req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:00.348206 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b28a7709c5465a8d561c707de367a8', 'request_id': 'req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:00.358526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:00.363855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] The token cache is being invalidate because project a5b28a7709c5465a8d561c707de367a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:17:00.364257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:00.365028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:00.367121 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1053/2106] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:00 2022] DELETE /identity/v3/projects/a5b28a7709c5465a8d561c707de367a8 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:00.370873 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e74abd-2567-4498-a159-78b8ce08a89d service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:00.383208 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e74abd-2567-4498-a159-78b8ce08a89d service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:00.462652 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ce4dd-fb0c-4473-a634-f86445851de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:00.462881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ce4dd-fb0c-4473-a634-f86445851de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:00.463226 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ce4dd-fb0c-4473-a634-f86445851de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:00.463566 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ce4dd-fb0c-4473-a634-f86445851de5 admin admin] PATH_INFO: `/v3/users/dd4d97b4cc2f4dd1b4eb6780184a4751` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:00.464878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ce4dd-fb0c-4473-a634-f86445851de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4d97b4cc2f4dd1b4eb6780184a4751)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:00.466944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ce4dd-fb0c-4473-a634-f86445851de5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:00.672562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:00.674585 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4a8ce4dd-fb0c-4473-a634-f86445851de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4d97b4cc2f4dd1b4eb6780184a4751'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:00.675882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4a8ce4dd-fb0c-4473-a634-f86445851de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4d97b4cc2f4dd1b4eb6780184a4751'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:00.689676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4a8ce4dd-fb0c-4473-a634-f86445851de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4d97b4cc2f4dd1b4eb6780184a4751'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:00.690359 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4a8ce4dd-fb0c-4473-a634-f86445851de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4d97b4cc2f4dd1b4eb6780184a4751'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:00.802092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4a8ce4dd-fb0c-4473-a634-f86445851de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4d97b4cc2f4dd1b4eb6780184a4751'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:00.823202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1054/2107] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:17:00 2022] DELETE /identity/v3/users/dd4d97b4cc2f4dd1b4eb6780184a4751 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:01.323617 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:01.325065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:01.340069 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa70df1-c1c1-4cb2-81a6-d8784fa9d71c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:01.399788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d097a-82b1-478c-b3b1-1c0232bb0512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:01.400411 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d097a-82b1-478c-b3b1-1c0232bb0512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:01.400685 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d097a-82b1-478c-b3b1-1c0232bb0512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:01.400959 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d097a-82b1-478c-b3b1-1c0232bb0512 admin admin] PATH_INFO: `/v3/projects/06f3c1357b7b4159a06579197807af3e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:01.402248 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d097a-82b1-478c-b3b1-1c0232bb0512 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f3c1357b7b4159a06579197807af3e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:01.407575 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d097a-82b1-478c-b3b1-1c0232bb0512 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:01.534010 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a46d097a-82b1-478c-b3b1-1c0232bb0512 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f3c1357b7b4159a06579197807af3e', 'request_id': 'req-a46d097a-82b1-478c-b3b1-1c0232bb0512'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:01.631227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a46d097a-82b1-478c-b3b1-1c0232bb0512 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f3c1357b7b4159a06579197807af3e', 'request_id': 'req-a46d097a-82b1-478c-b3b1-1c0232bb0512'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:01.637763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a46d097a-82b1-478c-b3b1-1c0232bb0512 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f3c1357b7b4159a06579197807af3e', 'request_id': 'req-a46d097a-82b1-478c-b3b1-1c0232bb0512'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:01.648861 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a46d097a-82b1-478c-b3b1-1c0232bb0512 admin admin] The token cache is being invalidate because project 06f3c1357b7b4159a06579197807af3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:17:01.649134 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a46d097a-82b1-478c-b3b1-1c0232bb0512 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:01.649797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a46d097a-82b1-478c-b3b1-1c0232bb0512 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:01.651263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1054/2108] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:01 2022] DELETE /identity/v3/projects/06f3c1357b7b4159a06579197807af3e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:01.656199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850da2-1639-4cd8-886c-3126a7dad76b None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:01.656662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850da2-1639-4cd8-886c-3126a7dad76b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:01.656753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b850da2-1639-4cd8-886c-3126a7dad76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:01.676763 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-5b850da2-1639-4cd8-886c-3126a7dad76b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:01.678018 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5b850da2-1639-4cd8-886c-3126a7dad76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:01.737721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1055/2109] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:01.745702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de00ad5-6cdb-4992-b10a-31f1f76c1acd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:01.745981 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de00ad5-6cdb-4992-b10a-31f1f76c1acd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:01.746249 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de00ad5-6cdb-4992-b10a-31f1f76c1acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:01.767132 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6de00ad5-6cdb-4992-b10a-31f1f76c1acd None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:01.768331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6de00ad5-6cdb-4992-b10a-31f1f76c1acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:01.776509 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1055/2110] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:01.780713 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b850da2-1639-4cd8-886c-3126a7dad76b None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:01.790708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b850da2-1639-4cd8-886c-3126a7dad76b None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:01.795346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6025ac-2cdf-4318-aaa5-0bf52f74fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:01.795929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6025ac-2cdf-4318-aaa5-0bf52f74fc9d admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:01.796202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6025ac-2cdf-4318-aaa5-0bf52f74fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:01.796467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6025ac-2cdf-4318-aaa5-0bf52f74fc9d admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:01.797101 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6025ac-2cdf-4318-aaa5-0bf52f74fc9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:17:01.797457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6025ac-2cdf-4318-aaa5-0bf52f74fc9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:01.799027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6025ac-2cdf-4318-aaa5-0bf52f74fc9d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:01.811268 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1056/2111] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:17:01.815434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de00ad5-6cdb-4992-b10a-31f1f76c1acd None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:01.825180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de00ad5-6cdb-4992-b10a-31f1f76c1acd None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:01.829960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb29a05-b930-4390-897f-1d1af7031f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:01.830541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb29a05-b930-4390-897f-1d1af7031f82 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:01.830813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb29a05-b930-4390-897f-1d1af7031f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:01.831084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb29a05-b930-4390-897f-1d1af7031f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:01.831786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb29a05-b930-4390-897f-1d1af7031f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:01.833836 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb29a05-b930-4390-897f-1d1af7031f82 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:01.936337 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1056/2112] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:17:01 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:17:01.940589 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6025ac-2cdf-4318-aaa5-0bf52f74fc9d admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:01.950875 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6025ac-2cdf-4318-aaa5-0bf52f74fc9d admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:02.011965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697abbd7-928f-4477-9a82-9eea06207977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:02.012498 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697abbd7-928f-4477-9a82-9eea06207977 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:02.012775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697abbd7-928f-4477-9a82-9eea06207977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:02.013044 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697abbd7-928f-4477-9a82-9eea06207977 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:02.013704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697abbd7-928f-4477-9a82-9eea06207977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:02.015604 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697abbd7-928f-4477-9a82-9eea06207977 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:02.242000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1057/2113] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:17:01 2022] POST /identity/v3/users => generated 287 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:17:02.246066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb29a05-b930-4390-897f-1d1af7031f82 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:02.256580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb29a05-b930-4390-897f-1d1af7031f82 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:02.261028 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce751d46-8ab0-4cf8-960f-54fcbaa379e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:02.261684 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce751d46-8ab0-4cf8-960f-54fcbaa379e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:02.261961 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce751d46-8ab0-4cf8-960f-54fcbaa379e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:02.262327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce751d46-8ab0-4cf8-960f-54fcbaa379e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:02.262953 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce751d46-8ab0-4cf8-960f-54fcbaa379e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:02.264527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce751d46-8ab0-4cf8-960f-54fcbaa379e1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:02.276589 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1057/2114] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:17:02.281737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697abbd7-928f-4477-9a82-9eea06207977 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:02.292403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697abbd7-928f-4477-9a82-9eea06207977 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:02.297257 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc044a-275a-4319-ac7e-1bd3a9e4a564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:02.297886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc044a-275a-4319-ac7e-1bd3a9e4a564 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:02.298164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc044a-275a-4319-ac7e-1bd3a9e4a564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:02.298433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc044a-275a-4319-ac7e-1bd3a9e4a564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:02.299105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc044a-275a-4319-ac7e-1bd3a9e4a564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:02.300700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc044a-275a-4319-ac7e-1bd3a9e4a564 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:02.312173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1058/2115] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:17:02.316484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce751d46-8ab0-4cf8-960f-54fcbaa379e1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:02.327008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce751d46-8ab0-4cf8-960f-54fcbaa379e1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:02.332134 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf32704-2ba1-4ca5-b151-a48748224c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:02.332793 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32704-2ba1-4ca5-b151-a48748224c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:02.333114 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32704-2ba1-4ca5-b151-a48748224c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:02.333464 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32704-2ba1-4ca5-b151-a48748224c74 admin admin] PATH_INFO: `/v3/projects/d3266f2764814b3f9cd9408b49cdfb8d/users/a09bc6016de54118b5056b129ea588ed/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:02.349420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf32704-2ba1-4ca5-b151-a48748224c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3266f2764814b3f9cd9408b49cdfb8d, user_id=a09bc6016de54118b5056b129ea588ed, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:02.352065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf32704-2ba1-4ca5-b151-a48748224c74 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:02.419840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1058/2116] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:17:02 2022] PUT /identity/v3/projects/d3266f2764814b3f9cd9408b49cdfb8d/users/a09bc6016de54118b5056b129ea588ed/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:17:02.432165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37f12c-a3a1-4a67-a9cb-bcf3dc25c8bd None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:02.432446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37f12c-a3a1-4a67-a9cb-bcf3dc25c8bd None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:02.432721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37f12c-a3a1-4a67-a9cb-bcf3dc25c8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:02.461742 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-fb37f12c-a3a1-4a67-a9cb-bcf3dc25c8bd None None] MFA Rules not processed for user `a09bc6016de54118b5056b129ea588ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:02.462984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-fb37f12c-a3a1-4a67-a9cb-bcf3dc25c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:02.480482 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:02.527825 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1059/2117] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:02.540239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf32704-2ba1-4ca5-b151-a48748224c74 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:02.542091 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0bf32704-2ba1-4ca5-b151-a48748224c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:02.570143 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:02.599466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf32704-2ba1-4ca5-b151-a48748224c74 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:02.603201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4751665-23ec-4b5c-a61b-40cf53966544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:02.603789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4751665-23ec-4b5c-a61b-40cf53966544 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:02.604063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4751665-23ec-4b5c-a61b-40cf53966544 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:02.604331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4751665-23ec-4b5c-a61b-40cf53966544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:02.613089 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4751665-23ec-4b5c-a61b-40cf53966544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:02.614549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4751665-23ec-4b5c-a61b-40cf53966544 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:02.623314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1059/2118] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:17:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:17:06.709145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37f12c-a3a1-4a67-a9cb-bcf3dc25c8bd None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:06.812314 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37f12c-a3a1-4a67-a9cb-bcf3dc25c8bd None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:06.817042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:06.817683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:06.817957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:06.818223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] PATH_INFO: `/v3/users/a09bc6016de54118b5056b129ea588ed` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:06.819331 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a09bc6016de54118b5056b129ea588ed)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:06.821212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:06.982775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a09bc6016de54118b5056b129ea588ed'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:06.983619 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a09bc6016de54118b5056b129ea588ed'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:06.996008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a09bc6016de54118b5056b129ea588ed'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:06.996675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a09bc6016de54118b5056b129ea588ed'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:07.070396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a09bc6016de54118b5056b129ea588ed'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:07.077074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:07.085347 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1060/2119] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:17:06 2022] DELETE /identity/v3/users/a09bc6016de54118b5056b129ea588ed => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:07.090128 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cd779-075d-4613-bebf-20ab257f4a2a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:07.090646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cd779-075d-4613-bebf-20ab257f4a2a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:07.090646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cd779-075d-4613-bebf-20ab257f4a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:07.142166 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-aa0cd779-075d-4613-bebf-20ab257f4a2a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:07.143405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aa0cd779-075d-4613-bebf-20ab257f4a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:07.203523 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1060/2120] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:07.213816 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:07.215157 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:07.287222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede83e4-94f5-49c0-ae9b-bb3e23d930b9 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:07.290776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4030b62-47ce-477c-ab81-074e75fece73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:07.291374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4030b62-47ce-477c-ab81-074e75fece73 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:07.291653 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4030b62-47ce-477c-ab81-074e75fece73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:07.291917 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4030b62-47ce-477c-ab81-074e75fece73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:07.300929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4030b62-47ce-477c-ab81-074e75fece73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:07.302373 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4030b62-47ce-477c-ab81-074e75fece73 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:07.312059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1061/2121] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:17:07.723350 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cd779-075d-4613-bebf-20ab257f4a2a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:07.726201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aa0cd779-075d-4613-bebf-20ab257f4a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:07.739449 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cd779-075d-4613-bebf-20ab257f4a2a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:07.744739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9edec-255e-4942-9171-148f080345f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:07.745418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9edec-255e-4942-9171-148f080345f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:07.745803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9edec-255e-4942-9171-148f080345f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:07.745965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9edec-255e-4942-9171-148f080345f3 admin admin] PATH_INFO: `/v3/projects/d3266f2764814b3f9cd9408b49cdfb8d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:07.747227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9edec-255e-4942-9171-148f080345f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3266f2764814b3f9cd9408b49cdfb8d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:07.748982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9edec-255e-4942-9171-148f080345f3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:07.888678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-60c9edec-255e-4942-9171-148f080345f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3266f2764814b3f9cd9408b49cdfb8d', 'request_id': 'req-60c9edec-255e-4942-9171-148f080345f3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:07.966295 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-60c9edec-255e-4942-9171-148f080345f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3266f2764814b3f9cd9408b49cdfb8d', 'request_id': 'req-60c9edec-255e-4942-9171-148f080345f3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:07.975046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-60c9edec-255e-4942-9171-148f080345f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3266f2764814b3f9cd9408b49cdfb8d', 'request_id': 'req-60c9edec-255e-4942-9171-148f080345f3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:07.986650 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-60c9edec-255e-4942-9171-148f080345f3 admin admin] The token cache is being invalidate because project d3266f2764814b3f9cd9408b49cdfb8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:17:07.986940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-60c9edec-255e-4942-9171-148f080345f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:07.987680 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-60c9edec-255e-4942-9171-148f080345f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:07.989945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1061/2122] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:07 2022] DELETE /identity/v3/projects/d3266f2764814b3f9cd9408b49cdfb8d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:07.994709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f950a2b-9de7-46c4-a486-b8a144ceef80 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:07.995160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f950a2b-9de7-46c4-a486-b8a144ceef80 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:07.995331 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f950a2b-9de7-46c4-a486-b8a144ceef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:08.049140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0f950a2b-9de7-46c4-a486-b8a144ceef80 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:08.050895 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0f950a2b-9de7-46c4-a486-b8a144ceef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:08.108337 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1062/2123] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:08.117372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9add1-1b24-414f-9567-cae80a6a8bcf None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:08.117874 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9add1-1b24-414f-9567-cae80a6a8bcf None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:08.118065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9add1-1b24-414f-9567-cae80a6a8bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:08.138025 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a1d9add1-1b24-414f-9567-cae80a6a8bcf None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:08.139228 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a1d9add1-1b24-414f-9567-cae80a6a8bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:08.147286 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1062/2124] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:08.151455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f950a2b-9de7-46c4-a486-b8a144ceef80 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:08.161744 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f950a2b-9de7-46c4-a486-b8a144ceef80 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:08.166316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4d74e-29f3-4394-a1a6-0a8b6fc09369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:08.166902 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4d74e-29f3-4394-a1a6-0a8b6fc09369 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:08.167179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4d74e-29f3-4394-a1a6-0a8b6fc09369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:08.167448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4d74e-29f3-4394-a1a6-0a8b6fc09369 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:08.168105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4d74e-29f3-4394-a1a6-0a8b6fc09369 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:17:08.168389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4d74e-29f3-4394-a1a6-0a8b6fc09369 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:08.170025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4d74e-29f3-4394-a1a6-0a8b6fc09369 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:08.182618 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1063/2125] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:17:08.186908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9add1-1b24-414f-9567-cae80a6a8bcf None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:08.196678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9add1-1b24-414f-9567-cae80a6a8bcf None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:08.201340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed08a2-c70f-4349-8c6d-b35257d11f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:08.201939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed08a2-c70f-4349-8c6d-b35257d11f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:08.202216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed08a2-c70f-4349-8c6d-b35257d11f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:08.202504 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed08a2-c70f-4349-8c6d-b35257d11f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:08.203117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed08a2-c70f-4349-8c6d-b35257d11f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:08.205002 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed08a2-c70f-4349-8c6d-b35257d11f09 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:08.221614 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:08.307494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1063/2126] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:17:08 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:17:08.311724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4d74e-29f3-4394-a1a6-0a8b6fc09369 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:08.323412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4d74e-29f3-4394-a1a6-0a8b6fc09369 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:08.368152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:08.381248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a430670-1102-49d8-bbef-534486b92fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:08.381876 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a430670-1102-49d8-bbef-534486b92fba admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:08.382156 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a430670-1102-49d8-bbef-534486b92fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:08.382427 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a430670-1102-49d8-bbef-534486b92fba admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:08.383071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a430670-1102-49d8-bbef-534486b92fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:08.385003 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a430670-1102-49d8-bbef-534486b92fba admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:08.475949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1064/2127] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:17:08 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:17:08.479815 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed08a2-c70f-4349-8c6d-b35257d11f09 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:08.491417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed08a2-c70f-4349-8c6d-b35257d11f09 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:08.496013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af114cf-656a-45ad-bb2b-8448d19f0bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:08.496610 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af114cf-656a-45ad-bb2b-8448d19f0bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:08.496892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af114cf-656a-45ad-bb2b-8448d19f0bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:08.497194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af114cf-656a-45ad-bb2b-8448d19f0bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:08.497871 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af114cf-656a-45ad-bb2b-8448d19f0bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:08.499470 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af114cf-656a-45ad-bb2b-8448d19f0bcf admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:08.510150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1064/2128] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:17:08.514081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a430670-1102-49d8-bbef-534486b92fba admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:08.524218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a430670-1102-49d8-bbef-534486b92fba admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:08.528839 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5cd73-6de3-4da9-9c2c-9744dcd563dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:08.529533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5cd73-6de3-4da9-9c2c-9744dcd563dc admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:08.529806 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5cd73-6de3-4da9-9c2c-9744dcd563dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:08.530072 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5cd73-6de3-4da9-9c2c-9744dcd563dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:08.530720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5cd73-6de3-4da9-9c2c-9744dcd563dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:08.532320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5cd73-6de3-4da9-9c2c-9744dcd563dc admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:08.542797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1065/2129] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:17:08.546816 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af114cf-656a-45ad-bb2b-8448d19f0bcf admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:08.557477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af114cf-656a-45ad-bb2b-8448d19f0bcf admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:08.562051 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c7578-5501-4e2e-a592-18ba5db5e04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:08.562682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c7578-5501-4e2e-a592-18ba5db5e04f admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:08.562961 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c7578-5501-4e2e-a592-18ba5db5e04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:08.563235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c7578-5501-4e2e-a592-18ba5db5e04f admin admin] PATH_INFO: `/v3/projects/869138e6d4c84c9198dff8fd7d65e456/users/dfad9c97bb324b27b6b11e84f50ab5d6/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:08.579153 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c7578-5501-4e2e-a592-18ba5db5e04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=869138e6d4c84c9198dff8fd7d65e456, user_id=dfad9c97bb324b27b6b11e84f50ab5d6, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:08.581867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c7578-5501-4e2e-a592-18ba5db5e04f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:08.692811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1065/2130] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:17:08 2022] PUT /identity/v3/projects/869138e6d4c84c9198dff8fd7d65e456/users/dfad9c97bb324b27b6b11e84f50ab5d6/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:08.702744 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6cdcf-0d7e-4e87-9f0d-f2f283b7a077 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:08.703145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6cdcf-0d7e-4e87-9f0d-f2f283b7a077 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:08.703483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6cdcf-0d7e-4e87-9f0d-f2f283b7a077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:08.734112 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d9c6cdcf-0d7e-4e87-9f0d-f2f283b7a077 None None] MFA Rules not processed for user `dfad9c97bb324b27b6b11e84f50ab5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:08.735321 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d9c6cdcf-0d7e-4e87-9f0d-f2f283b7a077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:08.802530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1066/2131] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:08.807090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c7578-5501-4e2e-a592-18ba5db5e04f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:08.869373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c7578-5501-4e2e-a592-18ba5db5e04f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:08.873998 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447d6b8-dc52-4b4b-aaf9-096292d97b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:08.874611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d6b8-dc52-4b4b-aaf9-096292d97b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:08.874880 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d6b8-dc52-4b4b-aaf9-096292d97b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:08.875147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447d6b8-dc52-4b4b-aaf9-096292d97b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:08.875776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447d6b8-dc52-4b4b-aaf9-096292d97b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:08.877694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447d6b8-dc52-4b4b-aaf9-096292d97b39 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:08.986149 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1066/2132] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:17:08 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:17:08.990754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6cdcf-0d7e-4e87-9f0d-f2f283b7a077 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:09.001678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c6cdcf-0d7e-4e87-9f0d-f2f283b7a077 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:09.060127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70022c-6298-42ae-82f7-cbe86e3f9c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:09.060734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70022c-6298-42ae-82f7-cbe86e3f9c85 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:09.061026 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70022c-6298-42ae-82f7-cbe86e3f9c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:09.061278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70022c-6298-42ae-82f7-cbe86e3f9c85 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:09.061940 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70022c-6298-42ae-82f7-cbe86e3f9c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:09.063835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70022c-6298-42ae-82f7-cbe86e3f9c85 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:09.139215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1067/2133] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:17:08 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:17:09.143612 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447d6b8-dc52-4b4b-aaf9-096292d97b39 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:09.154761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447d6b8-dc52-4b4b-aaf9-096292d97b39 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:09.159335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095bb82-9a6d-4e19-8dd0-79083d7e7238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:09.160486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095bb82-9a6d-4e19-8dd0-79083d7e7238 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:09.160944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095bb82-9a6d-4e19-8dd0-79083d7e7238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:09.161218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095bb82-9a6d-4e19-8dd0-79083d7e7238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:09.161911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095bb82-9a6d-4e19-8dd0-79083d7e7238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:09.163494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095bb82-9a6d-4e19-8dd0-79083d7e7238 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:09.174062 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1067/2134] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:17:09.178218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70022c-6298-42ae-82f7-cbe86e3f9c85 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:09.188630 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70022c-6298-42ae-82f7-cbe86e3f9c85 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:09.193354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2ae4a-4bd1-4669-9cf8-ff80dd7a6525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:09.193939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2ae4a-4bd1-4669-9cf8-ff80dd7a6525 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:09.194215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2ae4a-4bd1-4669-9cf8-ff80dd7a6525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:09.194544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2ae4a-4bd1-4669-9cf8-ff80dd7a6525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:09.195183 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2ae4a-4bd1-4669-9cf8-ff80dd7a6525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:09.196767 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2ae4a-4bd1-4669-9cf8-ff80dd7a6525 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:09.207665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1068/2135] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:17:09.211734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095bb82-9a6d-4e19-8dd0-79083d7e7238 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:09.221906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095bb82-9a6d-4e19-8dd0-79083d7e7238 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:09.227615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0936d4-8269-4da9-839e-5ae66760909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:09.228291 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0936d4-8269-4da9-839e-5ae66760909c admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:09.228569 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0936d4-8269-4da9-839e-5ae66760909c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:09.228838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0936d4-8269-4da9-839e-5ae66760909c admin admin] PATH_INFO: `/v3/projects/aef1780a6d9140c8a2f3a20f90078707/users/042690e24d9542f49365176a3d11c3b4/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:09.253091 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0936d4-8269-4da9-839e-5ae66760909c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef1780a6d9140c8a2f3a20f90078707, user_id=042690e24d9542f49365176a3d11c3b4, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:09.253091 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0936d4-8269-4da9-839e-5ae66760909c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:09.321081 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1068/2136] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:17:09 2022] PUT /identity/v3/projects/aef1780a6d9140c8a2f3a20f90078707/users/042690e24d9542f49365176a3d11c3b4/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:17:09.333626 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46655338-62b0-4103-adf5-3414b7cb8aef None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:09.333908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46655338-62b0-4103-adf5-3414b7cb8aef None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:09.334176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46655338-62b0-4103-adf5-3414b7cb8aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:09.364905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-46655338-62b0-4103-adf5-3414b7cb8aef None None] MFA Rules not processed for user `042690e24d9542f49365176a3d11c3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:09.366135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-46655338-62b0-4103-adf5-3414b7cb8aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:09.386614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:09.437421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1069/2137] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:09.442705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0936d4-8269-4da9-839e-5ae66760909c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:09.514269 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0936d4-8269-4da9-839e-5ae66760909c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:09.519608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c975695-dcd7-481f-aefb-17529bd6dd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:09.520650 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c975695-dcd7-481f-aefb-17529bd6dd1f admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:09.520924 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c975695-dcd7-481f-aefb-17529bd6dd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:09.521191 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c975695-dcd7-481f-aefb-17529bd6dd1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:09.521868 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c975695-dcd7-481f-aefb-17529bd6dd1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:09.524699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c975695-dcd7-481f-aefb-17529bd6dd1f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:09.556719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:09.656595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1069/2138] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:17:09 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:17:09.662395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46655338-62b0-4103-adf5-3414b7cb8aef None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:09.687124 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46655338-62b0-4103-adf5-3414b7cb8aef None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:09.759762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437bc39-a205-481b-80ee-0a58afd8df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:09.760665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437bc39-a205-481b-80ee-0a58afd8df42 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:09.761160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437bc39-a205-481b-80ee-0a58afd8df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:09.761634 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437bc39-a205-481b-80ee-0a58afd8df42 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:09.762415 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437bc39-a205-481b-80ee-0a58afd8df42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:09.764602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437bc39-a205-481b-80ee-0a58afd8df42 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:09.869372 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1070/2139] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:17:09 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:17:09.870173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c975695-dcd7-481f-aefb-17529bd6dd1f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:09.881442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c975695-dcd7-481f-aefb-17529bd6dd1f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:09.886648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac45946-dbc9-44b2-9414-93a5c0e43b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:09.888741 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac45946-dbc9-44b2-9414-93a5c0e43b80 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:09.888741 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac45946-dbc9-44b2-9414-93a5c0e43b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:09.888741 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac45946-dbc9-44b2-9414-93a5c0e43b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:09.888741 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac45946-dbc9-44b2-9414-93a5c0e43b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:09.890021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac45946-dbc9-44b2-9414-93a5c0e43b80 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:09.904888 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1070/2140] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:17:09.906376 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437bc39-a205-481b-80ee-0a58afd8df42 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:09.919558 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437bc39-a205-481b-80ee-0a58afd8df42 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:09.925736 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d62c6-7c61-45c1-ac2f-4312c50e8b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:09.929185 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d62c6-7c61-45c1-ac2f-4312c50e8b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:09.929185 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d62c6-7c61-45c1-ac2f-4312c50e8b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:09.929185 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d62c6-7c61-45c1-ac2f-4312c50e8b5c admin admin] PATH_INFO: `/v3/projects/5d97f54cf2cb40bd8dab5261ff4b20b4/users/c25a6b0c38ce4a65b48301215d920de3/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:09.944007 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d62c6-7c61-45c1-ac2f-4312c50e8b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d97f54cf2cb40bd8dab5261ff4b20b4, user_id=c25a6b0c38ce4a65b48301215d920de3, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:09.946876 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d62c6-7c61-45c1-ac2f-4312c50e8b5c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:10.014249 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1071/2141] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:17:09 2022] PUT /identity/v3/projects/5d97f54cf2cb40bd8dab5261ff4b20b4/users/c25a6b0c38ce4a65b48301215d920de3/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:10.017939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac45946-dbc9-44b2-9414-93a5c0e43b80 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:10.028136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac45946-dbc9-44b2-9414-93a5c0e43b80 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:10.084089 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f57eb6-7aaf-4e13-ad24-f7fb902ea9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:10.084684 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f57eb6-7aaf-4e13-ad24-f7fb902ea9cf admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:10.084956 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f57eb6-7aaf-4e13-ad24-f7fb902ea9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:10.085244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f57eb6-7aaf-4e13-ad24-f7fb902ea9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:10.085884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f57eb6-7aaf-4e13-ad24-f7fb902ea9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:10.087450 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f57eb6-7aaf-4e13-ad24-f7fb902ea9cf admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:10.097106 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1071/2142] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:17:10.101306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d62c6-7c61-45c1-ac2f-4312c50e8b5c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:10.112239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d62c6-7c61-45c1-ac2f-4312c50e8b5c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:10.117452 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab111867-9a9b-48e5-9dc7-e26956d10275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:10.118089 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab111867-9a9b-48e5-9dc7-e26956d10275 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:10.118359 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab111867-9a9b-48e5-9dc7-e26956d10275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:10.118625 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab111867-9a9b-48e5-9dc7-e26956d10275 admin admin] PATH_INFO: `/v3/projects/5d97f54cf2cb40bd8dab5261ff4b20b4/users/c25a6b0c38ce4a65b48301215d920de3/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:10.120496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab111867-9a9b-48e5-9dc7-e26956d10275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d97f54cf2cb40bd8dab5261ff4b20b4, user_id=c25a6b0c38ce4a65b48301215d920de3, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:10.123270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab111867-9a9b-48e5-9dc7-e26956d10275 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:10.134328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1072/2143] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:17:10 2022] PUT /identity/v3/projects/5d97f54cf2cb40bd8dab5261ff4b20b4/users/c25a6b0c38ce4a65b48301215d920de3/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:10.144894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb37647-27e0-4183-b13f-b07723d5a7d6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:10.145422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb37647-27e0-4183-b13f-b07723d5a7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:10.145596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb37647-27e0-4183-b13f-b07723d5a7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:10.173377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-afb37647-27e0-4183-b13f-b07723d5a7d6 None None] MFA Rules not processed for user `c25a6b0c38ce4a65b48301215d920de3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:10.174580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-afb37647-27e0-4183-b13f-b07723d5a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:10.244794 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1072/2144] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:10.256238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab111867-9a9b-48e5-9dc7-e26956d10275 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:10.257966 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ab111867-9a9b-48e5-9dc7-e26956d10275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:10.319964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab111867-9a9b-48e5-9dc7-e26956d10275 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:10.323644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f81e8-42bf-4138-8f2e-acba3f289f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:10.324265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f81e8-42bf-4138-8f2e-acba3f289f72 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:10.324544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f81e8-42bf-4138-8f2e-acba3f289f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:10.324816 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f81e8-42bf-4138-8f2e-acba3f289f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:10.355428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:10.384366 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f81e8-42bf-4138-8f2e-acba3f289f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:10.385964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f81e8-42bf-4138-8f2e-acba3f289f72 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:10.395738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1073/2145] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:17:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:17:12.382640 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb37647-27e0-4183-b13f-b07723d5a7d6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:12.384003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-afb37647-27e0-4183-b13f-b07723d5a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:12.395544 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb37647-27e0-4183-b13f-b07723d5a7d6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:12.399749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de4c0f-749c-4381-8a0a-ffa51cb1f3b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:12.400343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de4c0f-749c-4381-8a0a-ffa51cb1f3b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:12.400616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de4c0f-749c-4381-8a0a-ffa51cb1f3b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:12.400883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de4c0f-749c-4381-8a0a-ffa51cb1f3b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:12.458522 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de4c0f-749c-4381-8a0a-ffa51cb1f3b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:12.460061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de4c0f-749c-4381-8a0a-ffa51cb1f3b2 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:12.468944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1073/2146] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:17:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:17:12.674486 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf602f44-5199-4ab2-9362-d3fa7183cc86 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:12.674961 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf602f44-5199-4ab2-9362-d3fa7183cc86 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:12.675062 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf602f44-5199-4ab2-9362-d3fa7183cc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:12.704623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-cf602f44-5199-4ab2-9362-d3fa7183cc86 None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:12.705874 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-cf602f44-5199-4ab2-9362-d3fa7183cc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:12.768839 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1074/2147] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:17:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:12.891439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de4c0f-749c-4381-8a0a-ffa51cb1f3b2 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:12.893051 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-20de4c0f-749c-4381-8a0a-ffa51cb1f3b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:12.900655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:12.964348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de4c0f-749c-4381-8a0a-ffa51cb1f3b2 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:12.970238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56453cd4-da91-474c-9f00-09ba38dcbfa1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:12.970955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56453cd4-da91-474c-9f00-09ba38dcbfa1 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:12.971232 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56453cd4-da91-474c-9f00-09ba38dcbfa1 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:12.971500 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56453cd4-da91-474c-9f00-09ba38dcbfa1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:12.983180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56453cd4-da91-474c-9f00-09ba38dcbfa1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:12.986282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56453cd4-da91-474c-9f00-09ba38dcbfa1 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:12.994288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1074/2148] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:17:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:14.001618 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf602f44-5199-4ab2-9362-d3fa7183cc86 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:14.013647 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf602f44-5199-4ab2-9362-d3fa7183cc86 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:14.019143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54f91-0811-46a3-8898-347ac76fe605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:14.020031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54f91-0811-46a3-8898-347ac76fe605 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:14.020467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54f91-0811-46a3-8898-347ac76fe605 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:14.020981 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d54f91-0811-46a3-8898-347ac76fe605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:14.037956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d54f91-0811-46a3-8898-347ac76fe605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:14.040146 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d54f91-0811-46a3-8898-347ac76fe605 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:14.052933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1075/2149] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:17:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:17:14.079579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56453cd4-da91-474c-9f00-09ba38dcbfa1 service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:14.080460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-56453cd4-da91-474c-9f00-09ba38dcbfa1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:14.219777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56453cd4-da91-474c-9f00-09ba38dcbfa1 service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:14.231086 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efae46-b0cc-4052-8faf-2cbb9e3bf847 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:14.231455 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efae46-b0cc-4052-8faf-2cbb9e3bf847 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:14.231905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efae46-b0cc-4052-8faf-2cbb9e3bf847 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:14.232292 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efae46-b0cc-4052-8faf-2cbb9e3bf847 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:14.234908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-54efae46-b0cc-4052-8faf-2cbb9e3bf847 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:14.255576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efae46-b0cc-4052-8faf-2cbb9e3bf847 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:14.257724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efae46-b0cc-4052-8faf-2cbb9e3bf847 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:14.271580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1075/2150] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:17:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:17:19.307964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54f91-0811-46a3-8898-347ac76fe605 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:19.402566 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d54f91-0811-46a3-8898-347ac76fe605 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:19.407977 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:19.408649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:19.408951 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:19.409235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] PATH_INFO: `/v3/users/dfad9c97bb324b27b6b11e84f50ab5d6` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:19.411114 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfad9c97bb324b27b6b11e84f50ab5d6)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:19.413944 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:19.634596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfad9c97bb324b27b6b11e84f50ab5d6'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:19.635298 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfad9c97bb324b27b6b11e84f50ab5d6'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:19.636477 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:19.653505 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfad9c97bb324b27b6b11e84f50ab5d6'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:19.654494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfad9c97bb324b27b6b11e84f50ab5d6'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:20.121898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfad9c97bb324b27b6b11e84f50ab5d6'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:20.135760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1076/2151] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:17:19 2022] DELETE /identity/v3/users/dfad9c97bb324b27b6b11e84f50ab5d6 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:17:20.140842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a2e10-1e77-4ffe-a0ba-b7563cb5c52f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:20.141340 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a2e10-1e77-4ffe-a0ba-b7563cb5c52f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:20.141542 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a2e10-1e77-4ffe-a0ba-b7563cb5c52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:20.163128 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-148a2e10-1e77-4ffe-a0ba-b7563cb5c52f None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:20.164302 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-148a2e10-1e77-4ffe-a0ba-b7563cb5c52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:20.224080 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1076/2152] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:17:20.234471 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:20.235648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:20.294395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cf15f-5de3-45fa-80fb-b032ac03ab6c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:20.298038 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50feaab-e044-4550-a35e-69b9076cc3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:20.298636 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50feaab-e044-4550-a35e-69b9076cc3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:20.298907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50feaab-e044-4550-a35e-69b9076cc3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:20.299172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50feaab-e044-4550-a35e-69b9076cc3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:20.308830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50feaab-e044-4550-a35e-69b9076cc3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:20.310734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50feaab-e044-4550-a35e-69b9076cc3f3 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:20.320982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1077/2153] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:17:20.867490 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a2e10-1e77-4ffe-a0ba-b7563cb5c52f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:20.869469 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-148a2e10-1e77-4ffe-a0ba-b7563cb5c52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:20.881425 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:20.886414 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a2e10-1e77-4ffe-a0ba-b7563cb5c52f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:20.895504 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:20.898502 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:20.899870 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:20.899870 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] PATH_INFO: `/v3/projects/869138e6d4c84c9198dff8fd7d65e456` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:20.900891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869138e6d4c84c9198dff8fd7d65e456)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:20.903360 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:21.065325 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869138e6d4c84c9198dff8fd7d65e456', 'request_id': 'req-1f3053a3-d136-4b7d-84ad-f1c856157b50'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:21.147620 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869138e6d4c84c9198dff8fd7d65e456', 'request_id': 'req-1f3053a3-d136-4b7d-84ad-f1c856157b50'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:21.156115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869138e6d4c84c9198dff8fd7d65e456', 'request_id': 'req-1f3053a3-d136-4b7d-84ad-f1c856157b50'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:21.176401 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] The token cache is being invalidate because project 869138e6d4c84c9198dff8fd7d65e456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:17:21.176749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:21.177598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:21.180066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1077/2154] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:20 2022] DELETE /identity/v3/projects/869138e6d4c84c9198dff8fd7d65e456 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:21.184286 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50feaab-e044-4550-a35e-69b9076cc3f3 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:21.205024 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50feaab-e044-4550-a35e-69b9076cc3f3 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:21.281265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:21.281990 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:21.282294 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:21.282623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] PATH_INFO: `/v3/users/042690e24d9542f49365176a3d11c3b4` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:21.283871 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=042690e24d9542f49365176a3d11c3b4)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:21.286391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:21.519565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042690e24d9542f49365176a3d11c3b4'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:21.521020 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042690e24d9542f49365176a3d11c3b4'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:21.539826 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042690e24d9542f49365176a3d11c3b4'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:21.540466 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042690e24d9542f49365176a3d11c3b4'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:21.544411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:21.619406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042690e24d9542f49365176a3d11c3b4'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:21.643587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1078/2155] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:17:21 2022] DELETE /identity/v3/users/042690e24d9542f49365176a3d11c3b4 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:17:22.131922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:22.136666 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:22.151085 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3053a3-d136-4b7d-84ad-f1c856157b50 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:22.223258 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:22.223923 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:22.224210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:22.224499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] PATH_INFO: `/v3/projects/aef1780a6d9140c8a2f3a20f90078707` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:22.226815 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef1780a6d9140c8a2f3a20f90078707)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:22.228695 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:22.348635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef1780a6d9140c8a2f3a20f90078707', 'request_id': 'req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:22.435715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef1780a6d9140c8a2f3a20f90078707', 'request_id': 'req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:22.442977 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef1780a6d9140c8a2f3a20f90078707', 'request_id': 'req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:22.453775 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] The token cache is being invalidate because project aef1780a6d9140c8a2f3a20f90078707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:17:22.454062 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:22.454725 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:22.456207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1078/2156] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:22 2022] DELETE /identity/v3/projects/aef1780a6d9140c8a2f3a20f90078707 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:22.462347 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:22.463845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:22.477671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46659780-769b-454e-bf25-60a3f4b0f604 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:22.557651 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc1cb5-e37e-4986-b3cd-668bc86c9303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:22.558734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc1cb5-e37e-4986-b3cd-668bc86c9303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:22.560907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc1cb5-e37e-4986-b3cd-668bc86c9303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:22.561380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc1cb5-e37e-4986-b3cd-668bc86c9303 admin admin] PATH_INFO: `/v3/users/c25a6b0c38ce4a65b48301215d920de3` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:22.566801 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc1cb5-e37e-4986-b3cd-668bc86c9303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c25a6b0c38ce4a65b48301215d920de3)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:22.571219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc1cb5-e37e-4986-b3cd-668bc86c9303 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:22.888819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a8cc1cb5-e37e-4986-b3cd-668bc86c9303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c25a6b0c38ce4a65b48301215d920de3'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:22.891031 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a8cc1cb5-e37e-4986-b3cd-668bc86c9303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c25a6b0c38ce4a65b48301215d920de3'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:22.921961 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a8cc1cb5-e37e-4986-b3cd-668bc86c9303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c25a6b0c38ce4a65b48301215d920de3'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:22.929449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a8cc1cb5-e37e-4986-b3cd-668bc86c9303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c25a6b0c38ce4a65b48301215d920de3'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:23.053108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a8cc1cb5-e37e-4986-b3cd-668bc86c9303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c25a6b0c38ce4a65b48301215d920de3'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:23.072993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1079/2157] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:17:22 2022] DELETE /identity/v3/users/c25a6b0c38ce4a65b48301215d920de3 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:23.650071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:23.651652 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:23.664835 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54338bb4-f9cd-4ad1-b38c-78b9b7bc682b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:23.677479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:23.721493 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a34159-43bd-4042-89ad-65b0738e124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:23.722113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34159-43bd-4042-89ad-65b0738e124b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:23.726283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34159-43bd-4042-89ad-65b0738e124b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:23.726283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a34159-43bd-4042-89ad-65b0738e124b admin admin] PATH_INFO: `/v3/projects/5d97f54cf2cb40bd8dab5261ff4b20b4` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:23.726283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a34159-43bd-4042-89ad-65b0738e124b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d97f54cf2cb40bd8dab5261ff4b20b4)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:23.726283 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a34159-43bd-4042-89ad-65b0738e124b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:23.853965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b7a34159-43bd-4042-89ad-65b0738e124b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d97f54cf2cb40bd8dab5261ff4b20b4', 'request_id': 'req-b7a34159-43bd-4042-89ad-65b0738e124b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:24.007185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b7a34159-43bd-4042-89ad-65b0738e124b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d97f54cf2cb40bd8dab5261ff4b20b4', 'request_id': 'req-b7a34159-43bd-4042-89ad-65b0738e124b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:24.014093 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b7a34159-43bd-4042-89ad-65b0738e124b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d97f54cf2cb40bd8dab5261ff4b20b4', 'request_id': 'req-b7a34159-43bd-4042-89ad-65b0738e124b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:24.026107 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b7a34159-43bd-4042-89ad-65b0738e124b admin admin] The token cache is being invalidate because project 5d97f54cf2cb40bd8dab5261ff4b20b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:17:24.028156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b7a34159-43bd-4042-89ad-65b0738e124b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:24.028156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b7a34159-43bd-4042-89ad-65b0738e124b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:24.028580 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1079/2158] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:23 2022] DELETE /identity/v3/projects/5d97f54cf2cb40bd8dab5261ff4b20b4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:24.034299 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105532aa-4653-4d11-8537-2ae4bc072237 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:24.034780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105532aa-4653-4d11-8537-2ae4bc072237 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:24.034876 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105532aa-4653-4d11-8537-2ae4bc072237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:24.055312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-105532aa-4653-4d11-8537-2ae4bc072237 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:24.056509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-105532aa-4653-4d11-8537-2ae4bc072237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:24.121471 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1080/2159] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:17:24.129124 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ba8ca-888e-46ef-b7ef-7252f810d7f0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:24.129884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ba8ca-888e-46ef-b7ef-7252f810d7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:24.129884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ba8ca-888e-46ef-b7ef-7252f810d7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:24.152254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-377ba8ca-888e-46ef-b7ef-7252f810d7f0 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:24.153684 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-377ba8ca-888e-46ef-b7ef-7252f810d7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:24.169118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1080/2160] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:17:24.170232 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105532aa-4653-4d11-8537-2ae4bc072237 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:24.183774 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105532aa-4653-4d11-8537-2ae4bc072237 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:24.193751 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8908262-90d7-4a88-b536-cb7ac2a3bb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:24.194704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8908262-90d7-4a88-b536-cb7ac2a3bb40 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:24.197181 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8908262-90d7-4a88-b536-cb7ac2a3bb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:24.197367 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8908262-90d7-4a88-b536-cb7ac2a3bb40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:24.198010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8908262-90d7-4a88-b536-cb7ac2a3bb40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:17:24.198313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8908262-90d7-4a88-b536-cb7ac2a3bb40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:24.199945 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8908262-90d7-4a88-b536-cb7ac2a3bb40 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:24.206370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:24.223345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1081/2161] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:17:24.229665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ba8ca-888e-46ef-b7ef-7252f810d7f0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:24.250024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ba8ca-888e-46ef-b7ef-7252f810d7f0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:24.255238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf9b7b-2fcf-465f-90c9-543a579834f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:24.255974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf9b7b-2fcf-465f-90c9-543a579834f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:24.256310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf9b7b-2fcf-465f-90c9-543a579834f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:24.256650 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf9b7b-2fcf-465f-90c9-543a579834f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:24.257393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf9b7b-2fcf-465f-90c9-543a579834f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:24.259627 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdf9b7b-2fcf-465f-90c9-543a579834f3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:24.427446 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1081/2162] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:17:24 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:17:24.429618 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8908262-90d7-4a88-b536-cb7ac2a3bb40 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:24.449812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8908262-90d7-4a88-b536-cb7ac2a3bb40 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:24.536840 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf5317-70d0-4241-b289-2cfb54e017e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:24.537993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf5317-70d0-4241-b289-2cfb54e017e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:24.538699 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf5317-70d0-4241-b289-2cfb54e017e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:24.539188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf5317-70d0-4241-b289-2cfb54e017e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:24.540210 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf5317-70d0-4241-b289-2cfb54e017e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:24.544025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf5317-70d0-4241-b289-2cfb54e017e2 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:24.695153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1082/2163] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:17:24 2022] POST /identity/v3/users => generated 287 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:17:24.698840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf9b7b-2fcf-465f-90c9-543a579834f3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:24.709833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf9b7b-2fcf-465f-90c9-543a579834f3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:24.714997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a07fea-3c59-44e6-bb86-ea1d9eea7aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:24.715724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a07fea-3c59-44e6-bb86-ea1d9eea7aad admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:24.716041 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a07fea-3c59-44e6-bb86-ea1d9eea7aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:24.716671 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a07fea-3c59-44e6-bb86-ea1d9eea7aad admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:24.717474 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a07fea-3c59-44e6-bb86-ea1d9eea7aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:24.720367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a07fea-3c59-44e6-bb86-ea1d9eea7aad admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:24.732689 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1082/2164] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:17:24.736710 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf5317-70d0-4241-b289-2cfb54e017e2 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:24.748493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf5317-70d0-4241-b289-2cfb54e017e2 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:24.753685 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649df38-e664-4e22-b9bf-84ce442c5893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:24.754275 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649df38-e664-4e22-b9bf-84ce442c5893 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:24.754548 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649df38-e664-4e22-b9bf-84ce442c5893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:24.754813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649df38-e664-4e22-b9bf-84ce442c5893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:24.755445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649df38-e664-4e22-b9bf-84ce442c5893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:24.757746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649df38-e664-4e22-b9bf-84ce442c5893 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:24.769917 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1083/2165] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:17:24.774150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a07fea-3c59-44e6-bb86-ea1d9eea7aad admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:24.784422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a07fea-3c59-44e6-bb86-ea1d9eea7aad admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:24.789648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f9f8d-3c8d-42ad-8891-c31477dd71fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:24.795201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f9f8d-3c8d-42ad-8891-c31477dd71fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:24.795201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f9f8d-3c8d-42ad-8891-c31477dd71fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:24.795201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f9f8d-3c8d-42ad-8891-c31477dd71fd admin admin] PATH_INFO: `/v3/projects/792c14fa18fa4fc7a6ee4b6ede1413ce/users/305af63c5318416288d79625962d8d54/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:24.807913 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f9f8d-3c8d-42ad-8891-c31477dd71fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=792c14fa18fa4fc7a6ee4b6ede1413ce, user_id=305af63c5318416288d79625962d8d54, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:24.810649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f9f8d-3c8d-42ad-8891-c31477dd71fd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:24.927280 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1083/2166] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:17:24 2022] PUT /identity/v3/projects/792c14fa18fa4fc7a6ee4b6ede1413ce/users/305af63c5318416288d79625962d8d54/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:24.947211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c695223-e8d8-481a-8477-0eda12bb67f6 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:24.947211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c695223-e8d8-481a-8477-0eda12bb67f6 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:24.947211 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c695223-e8d8-481a-8477-0eda12bb67f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:24.973589 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-1c695223-e8d8-481a-8477-0eda12bb67f6 None None] MFA Rules not processed for user `305af63c5318416288d79625962d8d54`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:24.975306 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-1c695223-e8d8-481a-8477-0eda12bb67f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:25.046139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1084/2167] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:25.059265 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f9f8d-3c8d-42ad-8891-c31477dd71fd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:25.061087 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-001f9f8d-3c8d-42ad-8891-c31477dd71fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:25.109709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:25.121326 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f9f8d-3c8d-42ad-8891-c31477dd71fd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:25.124986 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd9262-4d5f-4931-940f-c9ff9468125f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:25.125616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd9262-4d5f-4931-940f-c9ff9468125f service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:25.125892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd9262-4d5f-4931-940f-c9ff9468125f service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:25.126159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd9262-4d5f-4931-940f-c9ff9468125f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:25.134999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd9262-4d5f-4931-940f-c9ff9468125f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:25.136406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd9262-4d5f-4931-940f-c9ff9468125f service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:25.145032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1084/2168] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:17:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:17:25.171579 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c695223-e8d8-481a-8477-0eda12bb67f6 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:25.240883 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c695223-e8d8-481a-8477-0eda12bb67f6 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:25.245412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:25.246027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:25.246300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:25.246590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] PATH_INFO: `/v3/users/305af63c5318416288d79625962d8d54` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:25.247710 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=305af63c5318416288d79625962d8d54)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:25.249637 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:25.251883 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:25.523106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '305af63c5318416288d79625962d8d54'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:25.523748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '305af63c5318416288d79625962d8d54'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:25.535611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '305af63c5318416288d79625962d8d54'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:25.536262 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '305af63c5318416288d79625962d8d54'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:25.629812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '305af63c5318416288d79625962d8d54'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:25.643172 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1085/2169] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:17:25 2022] DELETE /identity/v3/users/305af63c5318416288d79625962d8d54 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:25.650862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d69c45-c5b1-406d-b71c-5b174d386e52 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:25.651144 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d69c45-c5b1-406d-b71c-5b174d386e52 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:25.651413 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d69c45-c5b1-406d-b71c-5b174d386e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:25.671852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-59d69c45-c5b1-406d-b71c-5b174d386e52 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:25.673057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-59d69c45-c5b1-406d-b71c-5b174d386e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:25.740332 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1085/2170] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:25.753361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:25.753361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:25.841393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cfc53-8a18-47bc-833f-3ee85c818193 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:25.844960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c77bf5-68fb-4433-8a9f-42310c5e31ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:25.845599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77bf5-68fb-4433-8a9f-42310c5e31ef service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:25.845874 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77bf5-68fb-4433-8a9f-42310c5e31ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:25.846165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c77bf5-68fb-4433-8a9f-42310c5e31ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:25.855151 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c77bf5-68fb-4433-8a9f-42310c5e31ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:25.856845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c77bf5-68fb-4433-8a9f-42310c5e31ef service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:25.866182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1086/2171] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:17:26.312853 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d69c45-c5b1-406d-b71c-5b174d386e52 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:26.314470 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-59d69c45-c5b1-406d-b71c-5b174d386e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:26.332671 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d69c45-c5b1-406d-b71c-5b174d386e52 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:26.337935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:26.338571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:26.343944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:26.343944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] PATH_INFO: `/v3/projects/792c14fa18fa4fc7a6ee4b6ede1413ce` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:26.343944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=792c14fa18fa4fc7a6ee4b6ede1413ce)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:26.343944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:26.501294 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '792c14fa18fa4fc7a6ee4b6ede1413ce', 'request_id': 'req-5680a20b-4f39-4a9b-93bd-b1f94b100b65'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:26.619117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '792c14fa18fa4fc7a6ee4b6ede1413ce', 'request_id': 'req-5680a20b-4f39-4a9b-93bd-b1f94b100b65'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:26.626532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '792c14fa18fa4fc7a6ee4b6ede1413ce', 'request_id': 'req-5680a20b-4f39-4a9b-93bd-b1f94b100b65'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:26.639096 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] The token cache is being invalidate because project 792c14fa18fa4fc7a6ee4b6ede1413ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:17:26.639539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:26.640293 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:17:26.642196 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1086/2172] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:26 2022] DELETE /identity/v3/projects/792c14fa18fa4fc7a6ee4b6ede1413ce => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:17:34.383055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dfe3c-7884-4a03-b361-4263ab08a11c None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:34.383611 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dfe3c-7884-4a03-b361-4263ab08a11c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:34.383723 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dfe3c-7884-4a03-b361-4263ab08a11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:34.404866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-481dfe3c-7884-4a03-b361-4263ab08a11c None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:34.406227 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-481dfe3c-7884-4a03-b361-4263ab08a11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:34.466784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1087/2173] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:17:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:34.479032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:34.480526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:34.551847 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680a20b-4f39-4a9b-93bd-b1f94b100b65 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:34.557701 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c44148-5b4d-463b-8bc4-ad9aa89920b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:34.558297 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c44148-5b4d-463b-8bc4-ad9aa89920b0 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:34.558575 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c44148-5b4d-463b-8bc4-ad9aa89920b0 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:34.558845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c44148-5b4d-463b-8bc4-ad9aa89920b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:34.566715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c44148-5b4d-463b-8bc4-ad9aa89920b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:34.568279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c44148-5b4d-463b-8bc4-ad9aa89920b0 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:34.573423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:34.577160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1087/2174] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:17:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:44.459637 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:54.239891 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d55cfe-1041-49ce-872e-59a2e0abea00 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:54.240504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d55cfe-1041-49ce-872e-59a2e0abea00 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:54.240504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d55cfe-1041-49ce-872e-59a2e0abea00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:54.261108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-05d55cfe-1041-49ce-872e-59a2e0abea00 None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:17:54.262458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-05d55cfe-1041-49ce-872e-59a2e0abea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:17:54.269808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1088/2175] 10.222.0.45 () {58 vars in 967 bytes} [Mon Oct 31 15:17:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:17:54.282412 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c44148-5b4d-463b-8bc4-ad9aa89920b0 service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:17:54.293725 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c44148-5b4d-463b-8bc4-ad9aa89920b0 service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:17:54.298725 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261b85-9a8b-4596-9987-b35d6d1e0636 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:17:54.299309 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261b85-9a8b-4596-9987-b35d6d1e0636 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:17:54.299584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261b85-9a8b-4596-9987-b35d6d1e0636 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:17:54.299853 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261b85-9a8b-4596-9987-b35d6d1e0636 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:17:54.308627 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c261b85-9a8b-4596-9987-b35d6d1e0636 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:17:54.310220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c261b85-9a8b-4596-9987-b35d6d1e0636 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:17:54.318168 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1088/2176] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:17:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:00.515517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d55cfe-1041-49ce-872e-59a2e0abea00 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:00.516919 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-05d55cfe-1041-49ce-872e-59a2e0abea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:00.573062 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d55cfe-1041-49ce-872e-59a2e0abea00 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:00.576827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256bca6-c3bc-4509-8f92-3fbab31cb6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:00.577457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256bca6-c3bc-4509-8f92-3fbab31cb6ed service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:00.577732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256bca6-c3bc-4509-8f92-3fbab31cb6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:00.577999 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256bca6-c3bc-4509-8f92-3fbab31cb6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:00.579678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9256bca6-c3bc-4509-8f92-3fbab31cb6ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:00.640609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256bca6-c3bc-4509-8f92-3fbab31cb6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:00.642092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256bca6-c3bc-4509-8f92-3fbab31cb6ed service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:00.651530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1089/2177] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:04.259318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261b85-9a8b-4596-9987-b35d6d1e0636 service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:04.260631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4c261b85-9a8b-4596-9987-b35d6d1e0636 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:04.275862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261b85-9a8b-4596-9987-b35d6d1e0636 service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:04.281416 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5e526-adb4-4c00-8fd3-82af0d5837db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:04.282053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e526-adb4-4c00-8fd3-82af0d5837db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:04.282328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e526-adb4-4c00-8fd3-82af0d5837db admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:04.282596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e526-adb4-4c00-8fd3-82af0d5837db admin admin] PATH_INFO: `/v3/users/e5109f4de7554ecf9840ff6922eb05fa` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:04.283803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5e526-adb4-4c00-8fd3-82af0d5837db admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5109f4de7554ecf9840ff6922eb05fa)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:04.286236 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5e526-adb4-4c00-8fd3-82af0d5837db admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:04.460393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-66f5e526-adb4-4c00-8fd3-82af0d5837db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5109f4de7554ecf9840ff6922eb05fa'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:04.461037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-66f5e526-adb4-4c00-8fd3-82af0d5837db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5109f4de7554ecf9840ff6922eb05fa'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:04.468623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-66f5e526-adb4-4c00-8fd3-82af0d5837db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5109f4de7554ecf9840ff6922eb05fa'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:04.538266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-66f5e526-adb4-4c00-8fd3-82af0d5837db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5109f4de7554ecf9840ff6922eb05fa'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:04.552427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-66f5e526-adb4-4c00-8fd3-82af0d5837db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5109f4de7554ecf9840ff6922eb05fa'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:04.558767 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1089/2178] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:18:04 2022] DELETE /identity/v3/users/e5109f4de7554ecf9840ff6922eb05fa => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:04.796269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256bca6-c3bc-4509-8f92-3fbab31cb6ed service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:04.807446 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256bca6-c3bc-4509-8f92-3fbab31cb6ed service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:04.868214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:04.868830 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:04.869113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:04.869396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39 admin admin] PATH_INFO: `/v3/projects/88b1739a165147a0a3781362836d137b` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:04.870499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b1739a165147a0a3781362836d137b)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:04.872585 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:04.982177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:04.985169 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b1739a165147a0a3781362836d137b', 'request_id': 'req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:05.058169 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b1739a165147a0a3781362836d137b', 'request_id': 'req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:05.065674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b1739a165147a0a3781362836d137b', 'request_id': 'req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:05.077032 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39 admin admin] The token cache is being invalidate because project 88b1739a165147a0a3781362836d137b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:18:05.079982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:05.079982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-b217ef75-d249-4bb0-8dac-a0ccb8d11c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:05.079982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1090/2179] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:04 2022] DELETE /identity/v3/projects/88b1739a165147a0a3781362836d137b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:05.084341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef05ae-d75b-404e-9f14-ad92f886dcd2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:05.084628 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef05ae-d75b-404e-9f14-ad92f886dcd2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:05.084906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef05ae-d75b-404e-9f14-ad92f886dcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:05.104997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-95ef05ae-d75b-404e-9f14-ad92f886dcd2 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:05.106809 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-95ef05ae-d75b-404e-9f14-ad92f886dcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:05.165667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1090/2180] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:05.174736 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4f900-485b-4670-8d75-aa540a54b35f None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:05.175015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4f900-485b-4670-8d75-aa540a54b35f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:05.175285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4f900-485b-4670-8d75-aa540a54b35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:05.195980 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-64a4f900-485b-4670-8d75-aa540a54b35f None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:05.197229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-64a4f900-485b-4670-8d75-aa540a54b35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:05.205716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1091/2181] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:05.209988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef05ae-d75b-404e-9f14-ad92f886dcd2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:05.219898 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef05ae-d75b-404e-9f14-ad92f886dcd2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:05.224361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a426ad-4122-49a8-a62e-9e3007edf507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:05.224952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a426ad-4122-49a8-a62e-9e3007edf507 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:05.225231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a426ad-4122-49a8-a62e-9e3007edf507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:05.225530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a426ad-4122-49a8-a62e-9e3007edf507 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:05.226180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a426ad-4122-49a8-a62e-9e3007edf507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:18:05.226484 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a426ad-4122-49a8-a62e-9e3007edf507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:05.228073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a426ad-4122-49a8-a62e-9e3007edf507 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:05.239492 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1091/2182] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:18:05.243807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4f900-485b-4670-8d75-aa540a54b35f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:05.253973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4f900-485b-4670-8d75-aa540a54b35f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:05.258479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd636e3-c387-4d98-b1f4-c490a2f33448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:05.259063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd636e3-c387-4d98-b1f4-c490a2f33448 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:05.259337 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd636e3-c387-4d98-b1f4-c490a2f33448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:05.259601 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd636e3-c387-4d98-b1f4-c490a2f33448 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:05.260212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd636e3-c387-4d98-b1f4-c490a2f33448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:05.262679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd636e3-c387-4d98-b1f4-c490a2f33448 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:05.396735 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1092/2183] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:05 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:05.401050 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a426ad-4122-49a8-a62e-9e3007edf507 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:05.411008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a426ad-4122-49a8-a62e-9e3007edf507 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:05.456117 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:05.469060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408bd69-5141-4169-bb28-9f959eed6f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:05.469712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408bd69-5141-4169-bb28-9f959eed6f34 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:05.469993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408bd69-5141-4169-bb28-9f959eed6f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:05.470265 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408bd69-5141-4169-bb28-9f959eed6f34 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:05.470929 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408bd69-5141-4169-bb28-9f959eed6f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:05.472831 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408bd69-5141-4169-bb28-9f959eed6f34 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:05.572119 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1092/2184] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:05 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:18:05.576616 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd636e3-c387-4d98-b1f4-c490a2f33448 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:05.586967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd636e3-c387-4d98-b1f4-c490a2f33448 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:05.592162 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e9be-34b7-48a6-a09e-8ea6e1f751d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:05.592782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e9be-34b7-48a6-a09e-8ea6e1f751d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:05.593055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e9be-34b7-48a6-a09e-8ea6e1f751d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:05.593380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e9be-34b7-48a6-a09e-8ea6e1f751d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:05.594132 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614e9be-34b7-48a6-a09e-8ea6e1f751d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:05.595719 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614e9be-34b7-48a6-a09e-8ea6e1f751d5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:05.606684 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1093/2185] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:05.610742 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408bd69-5141-4169-bb28-9f959eed6f34 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:05.620518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408bd69-5141-4169-bb28-9f959eed6f34 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:05.626151 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172933d0-5289-400e-91f4-93d1033e339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:05.626734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172933d0-5289-400e-91f4-93d1033e339b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:05.627009 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172933d0-5289-400e-91f4-93d1033e339b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:05.627277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172933d0-5289-400e-91f4-93d1033e339b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:05.627952 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172933d0-5289-400e-91f4-93d1033e339b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:05.629550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172933d0-5289-400e-91f4-93d1033e339b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:05.640292 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1093/2186] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:05.644077 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e9be-34b7-48a6-a09e-8ea6e1f751d5 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:05.653870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e9be-34b7-48a6-a09e-8ea6e1f751d5 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:05.658635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946f817-4c54-44ea-84ef-6bd5e655fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:05.659364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946f817-4c54-44ea-84ef-6bd5e655fdbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:05.659642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946f817-4c54-44ea-84ef-6bd5e655fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:05.659909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946f817-4c54-44ea-84ef-6bd5e655fdbb admin admin] PATH_INFO: `/v3/projects/8f97af477d2a42bf89e085a92e4bde25/users/1e25e53ef03c414dbcf819a5d4004cae/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:05.674776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946f817-4c54-44ea-84ef-6bd5e655fdbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f97af477d2a42bf89e085a92e4bde25, user_id=1e25e53ef03c414dbcf819a5d4004cae, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:05.677406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946f817-4c54-44ea-84ef-6bd5e655fdbb admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:05.749857 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1094/2187] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:05 2022] PUT /identity/v3/projects/8f97af477d2a42bf89e085a92e4bde25/users/1e25e53ef03c414dbcf819a5d4004cae/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:05.759905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053333f6-90c2-4b0e-9585-bdf28b8be5d6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:05.760182 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053333f6-90c2-4b0e-9585-bdf28b8be5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:05.760455 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053333f6-90c2-4b0e-9585-bdf28b8be5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:05.787704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-053333f6-90c2-4b0e-9585-bdf28b8be5d6 None None] MFA Rules not processed for user `1e25e53ef03c414dbcf819a5d4004cae`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:05.788946 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-053333f6-90c2-4b0e-9585-bdf28b8be5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:05.852553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1094/2188] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:18:05.864333 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946f817-4c54-44ea-84ef-6bd5e655fdbb admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:05.865975 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6946f817-4c54-44ea-84ef-6bd5e655fdbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:05.959114 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946f817-4c54-44ea-84ef-6bd5e655fdbb admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:05.964561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eac484-a383-48e3-8b65-dca5b95e932f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:05.965736 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eac484-a383-48e3-8b65-dca5b95e932f service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:05.966079 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eac484-a383-48e3-8b65-dca5b95e932f service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:05.966353 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eac484-a383-48e3-8b65-dca5b95e932f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:05.976448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eac484-a383-48e3-8b65-dca5b95e932f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:05.978113 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eac484-a383-48e3-8b65-dca5b95e932f service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:05.988489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1095/2189] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:12.094372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053333f6-90c2-4b0e-9585-bdf28b8be5d6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:12.154494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053333f6-90c2-4b0e-9585-bdf28b8be5d6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:12.158943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:12.159563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:12.159839 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:12.160110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] PATH_INFO: `/v3/users/1e25e53ef03c414dbcf819a5d4004cae` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:12.161243 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e25e53ef03c414dbcf819a5d4004cae)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:12.163158 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:12.322083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e25e53ef03c414dbcf819a5d4004cae'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:12.322717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e25e53ef03c414dbcf819a5d4004cae'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:12.329751 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e25e53ef03c414dbcf819a5d4004cae'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:12.331423 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:12.411971 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e25e53ef03c414dbcf819a5d4004cae'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:12.424722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e25e53ef03c414dbcf819a5d4004cae'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:12.430843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1095/2190] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:18:12 2022] DELETE /identity/v3/users/1e25e53ef03c414dbcf819a5d4004cae => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:12.436238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5d6fa-ee13-49d4-a3b8-03c768fc201a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:12.436724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5d6fa-ee13-49d4-a3b8-03c768fc201a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:12.436819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5d6fa-ee13-49d4-a3b8-03c768fc201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:12.457002 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-7fd5d6fa-ee13-49d4-a3b8-03c768fc201a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:12.458221 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7fd5d6fa-ee13-49d4-a3b8-03c768fc201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:12.487928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:12.517419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1096/2191] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:12.527289 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:12.529177 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:12.586972 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fe4de-60cb-4ad3-ba8c-aaf3e5a9ea1d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:12.591019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715f008-8c98-4f37-804f-aa35a2463dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:12.591609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715f008-8c98-4f37-804f-aa35a2463dfd service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:12.591883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715f008-8c98-4f37-804f-aa35a2463dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:12.592150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715f008-8c98-4f37-804f-aa35a2463dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:12.600882 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715f008-8c98-4f37-804f-aa35a2463dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:12.602308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715f008-8c98-4f37-804f-aa35a2463dfd service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:12.612259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1096/2192] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:12.990726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5d6fa-ee13-49d4-a3b8-03c768fc201a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:12.992193 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7fd5d6fa-ee13-49d4-a3b8-03c768fc201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:13.005880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5d6fa-ee13-49d4-a3b8-03c768fc201a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:13.010195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:13.010916 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:13.011188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:13.011458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55 admin admin] PATH_INFO: `/v3/projects/8f97af477d2a42bf89e085a92e4bde25` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:13.013462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f97af477d2a42bf89e085a92e4bde25)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:13.015409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:13.142869 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f97af477d2a42bf89e085a92e4bde25', 'request_id': 'req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:13.217599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f97af477d2a42bf89e085a92e4bde25', 'request_id': 'req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:13.224175 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f97af477d2a42bf89e085a92e4bde25', 'request_id': 'req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:13.235153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55 admin admin] The token cache is being invalidate because project 8f97af477d2a42bf89e085a92e4bde25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:18:13.235642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:13.236158 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c6799cab-2291-46d3-bd0d-fba3d6bcfa55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:13.237656 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1097/2193] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:12 2022] DELETE /identity/v3/projects/8f97af477d2a42bf89e085a92e4bde25 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:13.242579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c110e72-388a-447e-9352-cbbbbb932967 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:13.243063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c110e72-388a-447e-9352-cbbbbb932967 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:13.243156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c110e72-388a-447e-9352-cbbbbb932967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:13.262932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0c110e72-388a-447e-9352-cbbbbb932967 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:13.264147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0c110e72-388a-447e-9352-cbbbbb932967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:13.321573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1097/2194] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:13.329576 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52c9f-e0ca-4752-ba20-17120c54dfcb None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:13.329801 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52c9f-e0ca-4752-ba20-17120c54dfcb None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:13.330096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52c9f-e0ca-4752-ba20-17120c54dfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:13.350361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-5cc52c9f-e0ca-4752-ba20-17120c54dfcb None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:13.351562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5cc52c9f-e0ca-4752-ba20-17120c54dfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:13.360287 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1098/2195] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:13.364376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c110e72-388a-447e-9352-cbbbbb932967 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:13.374070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c110e72-388a-447e-9352-cbbbbb932967 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:13.378498 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697dd1b-9851-476c-845b-7ac01b7d9dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:13.379094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697dd1b-9851-476c-845b-7ac01b7d9dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:13.379354 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697dd1b-9851-476c-845b-7ac01b7d9dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:13.379619 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697dd1b-9851-476c-845b-7ac01b7d9dd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:13.380255 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697dd1b-9851-476c-845b-7ac01b7d9dd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:18:13.380552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697dd1b-9851-476c-845b-7ac01b7d9dd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:13.382147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697dd1b-9851-476c-845b-7ac01b7d9dd1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:13.393250 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1098/2196] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:18:13.397460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc52c9f-e0ca-4752-ba20-17120c54dfcb None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:13.407177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc52c9f-e0ca-4752-ba20-17120c54dfcb None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:13.411747 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9febc66-20a0-4e35-b039-0ca255e1e0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:13.412333 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9febc66-20a0-4e35-b039-0ca255e1e0ac admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:13.412609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9febc66-20a0-4e35-b039-0ca255e1e0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:13.412880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9febc66-20a0-4e35-b039-0ca255e1e0ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:13.413537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9febc66-20a0-4e35-b039-0ca255e1e0ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:13.415425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9febc66-20a0-4e35-b039-0ca255e1e0ac admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:13.504834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1099/2197] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:13 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:13.509063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697dd1b-9851-476c-845b-7ac01b7d9dd1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:13.518792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697dd1b-9851-476c-845b-7ac01b7d9dd1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:13.575774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa63c7a-d406-476b-979f-36514f4b3953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:13.576367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa63c7a-d406-476b-979f-36514f4b3953 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:13.576651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa63c7a-d406-476b-979f-36514f4b3953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:13.576906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa63c7a-d406-476b-979f-36514f4b3953 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:13.577564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa63c7a-d406-476b-979f-36514f4b3953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:13.582045 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa63c7a-d406-476b-979f-36514f4b3953 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:13.589144 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:13.703764 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1099/2198] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:13 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:13.707872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9febc66-20a0-4e35-b039-0ca255e1e0ac admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:13.719029 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9febc66-20a0-4e35-b039-0ca255e1e0ac admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:13.723714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee6800-c2e3-4a0f-b8ce-0eea04138fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:13.724327 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee6800-c2e3-4a0f-b8ce-0eea04138fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:13.724609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee6800-c2e3-4a0f-b8ce-0eea04138fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:13.725030 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee6800-c2e3-4a0f-b8ce-0eea04138fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:13.725696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee6800-c2e3-4a0f-b8ce-0eea04138fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:13.727305 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee6800-c2e3-4a0f-b8ce-0eea04138fb1 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:13.737508 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1100/2199] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:13.741331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa63c7a-d406-476b-979f-36514f4b3953 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:13.751461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa63c7a-d406-476b-979f-36514f4b3953 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:13.756174 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6607b7-a163-4755-abc2-4fca301279bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:13.756756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6607b7-a163-4755-abc2-4fca301279bf admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:13.757030 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6607b7-a163-4755-abc2-4fca301279bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:13.757315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6607b7-a163-4755-abc2-4fca301279bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:13.757958 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6607b7-a163-4755-abc2-4fca301279bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:13.759565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6607b7-a163-4755-abc2-4fca301279bf admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:13.771091 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1100/2200] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:18:13.775142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee6800-c2e3-4a0f-b8ce-0eea04138fb1 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:13.785666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee6800-c2e3-4a0f-b8ce-0eea04138fb1 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:13.790234 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16793db5-af3c-42f4-81bd-50bf60f484d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:13.790858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16793db5-af3c-42f4-81bd-50bf60f484d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:13.791131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16793db5-af3c-42f4-81bd-50bf60f484d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:13.791398 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16793db5-af3c-42f4-81bd-50bf60f484d5 admin admin] PATH_INFO: `/v3/projects/dce9fe4bfdfe4e56a9373611bfdd03d0/users/51d546ba397c463eb10203aa38f3604d/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:13.806188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16793db5-af3c-42f4-81bd-50bf60f484d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce9fe4bfdfe4e56a9373611bfdd03d0, user_id=51d546ba397c463eb10203aa38f3604d, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:13.808785 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16793db5-af3c-42f4-81bd-50bf60f484d5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:13.880308 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1101/2201] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:13 2022] PUT /identity/v3/projects/dce9fe4bfdfe4e56a9373611bfdd03d0/users/51d546ba397c463eb10203aa38f3604d/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:13.892601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c15d1-77e3-41a5-9b1e-ea69abb6da0d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:13.896419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c15d1-77e3-41a5-9b1e-ea69abb6da0d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:13.896419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c15d1-77e3-41a5-9b1e-ea69abb6da0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:13.921037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-776c15d1-77e3-41a5-9b1e-ea69abb6da0d None None] MFA Rules not processed for user `51d546ba397c463eb10203aa38f3604d`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:13.922258 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-776c15d1-77e3-41a5-9b1e-ea69abb6da0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:13.988527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1101/2202] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:13.992934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16793db5-af3c-42f4-81bd-50bf60f484d5 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:14.049839 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:14.055059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16793db5-af3c-42f4-81bd-50bf60f484d5 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:14.060396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb4c86-537d-48a8-abaa-77cdf5da4c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:14.062403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb4c86-537d-48a8-abaa-77cdf5da4c14 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:14.062403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb4c86-537d-48a8-abaa-77cdf5da4c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:14.062403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb4c86-537d-48a8-abaa-77cdf5da4c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:14.062403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb4c86-537d-48a8-abaa-77cdf5da4c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:14.064082 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb4c86-537d-48a8-abaa-77cdf5da4c14 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:14.154059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1102/2203] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:13 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:14.154243 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c15d1-77e3-41a5-9b1e-ea69abb6da0d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:14.164511 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c15d1-77e3-41a5-9b1e-ea69abb6da0d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:14.221544 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad7260-601a-490f-974d-4c4880e151ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:14.222143 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad7260-601a-490f-974d-4c4880e151ff admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:14.222448 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad7260-601a-490f-974d-4c4880e151ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:14.222724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad7260-601a-490f-974d-4c4880e151ff admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:14.223350 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad7260-601a-490f-974d-4c4880e151ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:14.225348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad7260-601a-490f-974d-4c4880e151ff admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:14.338017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1102/2204] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:14 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:18:14.348557 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb4c86-537d-48a8-abaa-77cdf5da4c14 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:14.359520 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb4c86-537d-48a8-abaa-77cdf5da4c14 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:14.363999 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511b13-f5d3-4938-b18c-0b86983aead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:14.364583 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511b13-f5d3-4938-b18c-0b86983aead2 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:14.364883 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511b13-f5d3-4938-b18c-0b86983aead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:14.365222 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72511b13-f5d3-4938-b18c-0b86983aead2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:14.365958 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72511b13-f5d3-4938-b18c-0b86983aead2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:14.367943 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72511b13-f5d3-4938-b18c-0b86983aead2 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:14.378488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1103/2205] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:14.383344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad7260-601a-490f-974d-4c4880e151ff admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:14.393814 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad7260-601a-490f-974d-4c4880e151ff admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:14.398470 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595da713-70ae-4558-a749-3c24e0aabc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:14.399127 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595da713-70ae-4558-a749-3c24e0aabc70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:14.399445 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595da713-70ae-4558-a749-3c24e0aabc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:14.399720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595da713-70ae-4558-a749-3c24e0aabc70 admin admin] PATH_INFO: `/v3/projects/3664ce53baa94e62a3d6c3931e7fba4d/users/8afe4f6d10a94e1ab4a013cd23399cbd/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:14.414951 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595da713-70ae-4558-a749-3c24e0aabc70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3664ce53baa94e62a3d6c3931e7fba4d, user_id=8afe4f6d10a94e1ab4a013cd23399cbd, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:14.417029 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595da713-70ae-4558-a749-3c24e0aabc70 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:14.532764 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1103/2206] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:14 2022] PUT /identity/v3/projects/3664ce53baa94e62a3d6c3931e7fba4d/users/8afe4f6d10a94e1ab4a013cd23399cbd/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:14.536713 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511b13-f5d3-4938-b18c-0b86983aead2 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:14.547294 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72511b13-f5d3-4938-b18c-0b86983aead2 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:14.603823 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6b55b-6a59-4cd8-b2ae-09062207df00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:14.604420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b55b-6a59-4cd8-b2ae-09062207df00 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:14.604696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b55b-6a59-4cd8-b2ae-09062207df00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:14.604964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b55b-6a59-4cd8-b2ae-09062207df00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:14.605637 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6b55b-6a59-4cd8-b2ae-09062207df00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:14.607868 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6b55b-6a59-4cd8-b2ae-09062207df00 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:14.617487 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1104/2207] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:14.621658 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595da713-70ae-4558-a749-3c24e0aabc70 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:14.632102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595da713-70ae-4558-a749-3c24e0aabc70 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:14.636700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de393fa-e36b-442d-9dc9-5287d28214d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:14.637881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de393fa-e36b-442d-9dc9-5287d28214d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:14.638154 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de393fa-e36b-442d-9dc9-5287d28214d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:14.638420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de393fa-e36b-442d-9dc9-5287d28214d6 admin admin] PATH_INFO: `/v3/projects/3664ce53baa94e62a3d6c3931e7fba4d/users/8afe4f6d10a94e1ab4a013cd23399cbd/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:14.640496 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de393fa-e36b-442d-9dc9-5287d28214d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3664ce53baa94e62a3d6c3931e7fba4d, user_id=8afe4f6d10a94e1ab4a013cd23399cbd, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:14.643175 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de393fa-e36b-442d-9dc9-5287d28214d6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:14.653936 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1104/2208] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:14 2022] PUT /identity/v3/projects/3664ce53baa94e62a3d6c3931e7fba4d/users/8afe4f6d10a94e1ab4a013cd23399cbd/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:14.664069 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280184df-ed6e-41d7-8e51-dbe2a5ae4755 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:14.664370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280184df-ed6e-41d7-8e51-dbe2a5ae4755 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:14.664640 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280184df-ed6e-41d7-8e51-dbe2a5ae4755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:14.692779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-280184df-ed6e-41d7-8e51-dbe2a5ae4755 None None] MFA Rules not processed for user `8afe4f6d10a94e1ab4a013cd23399cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:14.693933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-280184df-ed6e-41d7-8e51-dbe2a5ae4755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:14.763368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1105/2209] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:14.774844 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de393fa-e36b-442d-9dc9-5287d28214d6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:14.776595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5de393fa-e36b-442d-9dc9-5287d28214d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:14.803728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:14.855960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de393fa-e36b-442d-9dc9-5287d28214d6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:14.859632 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf88a8-374b-4982-8bd1-1df78a26c03a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:14.860260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf88a8-374b-4982-8bd1-1df78a26c03a service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:14.860538 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf88a8-374b-4982-8bd1-1df78a26c03a service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:14.860810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf88a8-374b-4982-8bd1-1df78a26c03a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:14.869795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf88a8-374b-4982-8bd1-1df78a26c03a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:14.871209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf88a8-374b-4982-8bd1-1df78a26c03a service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:14.881087 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1105/2210] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:15.108020 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280184df-ed6e-41d7-8e51-dbe2a5ae4755 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:15.117854 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280184df-ed6e-41d7-8e51-dbe2a5ae4755 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:15.122330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2ae39-6d09-41ac-bd78-8108aa23277f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:15.122960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2ae39-6d09-41ac-bd78-8108aa23277f service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:15.123220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2ae39-6d09-41ac-bd78-8108aa23277f service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:15.123483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2ae39-6d09-41ac-bd78-8108aa23277f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:15.173734 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:15.184808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2ae39-6d09-41ac-bd78-8108aa23277f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:15.186274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2ae39-6d09-41ac-bd78-8108aa23277f service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:15.195281 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1106/2211] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:18.785914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf88a8-374b-4982-8bd1-1df78a26c03a service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:18.848471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf88a8-374b-4982-8bd1-1df78a26c03a service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:18.852917 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:18.853557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:18.853838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:18.854107 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] PATH_INFO: `/v3/users/51d546ba397c463eb10203aa38f3604d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:18.855208 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d546ba397c463eb10203aa38f3604d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:18.857705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:19.158591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d546ba397c463eb10203aa38f3604d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:19.159284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d546ba397c463eb10203aa38f3604d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:19.167769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d546ba397c463eb10203aa38f3604d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:19.240757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d546ba397c463eb10203aa38f3604d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:19.253702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d546ba397c463eb10203aa38f3604d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:19.259728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1106/2212] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:18:18 2022] DELETE /identity/v3/users/51d546ba397c463eb10203aa38f3604d => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:19.264553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c62da4-d396-43c8-ac0b-947763d6759c None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:19.265062 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c62da4-d396-43c8-ac0b-947763d6759c None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:19.265174 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c62da4-d396-43c8-ac0b-947763d6759c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:19.287128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-74c62da4-d396-43c8-ac0b-947763d6759c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:19.288299 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-74c62da4-d396-43c8-ac0b-947763d6759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:19.348295 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1107/2213] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:19.358859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:19.360302 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:19.391433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:19.417521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcc82a-4ce5-434b-b9b1-c3a6f12732c4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:19.421637 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a165eeb-1d5a-4983-a7a4-54ddf6361d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:19.422273 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165eeb-1d5a-4983-a7a4-54ddf6361d55 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:19.422564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165eeb-1d5a-4983-a7a4-54ddf6361d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:19.422843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a165eeb-1d5a-4983-a7a4-54ddf6361d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:19.432046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a165eeb-1d5a-4983-a7a4-54ddf6361d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:19.433545 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a165eeb-1d5a-4983-a7a4-54ddf6361d55 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:19.443021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1107/2214] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:18:19.863408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c62da4-d396-43c8-ac0b-947763d6759c None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:19.866198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-74c62da4-d396-43c8-ac0b-947763d6759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:19.878587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c62da4-d396-43c8-ac0b-947763d6759c None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:19.883162 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:19.883837 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:19.884756 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:19.885032 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] PATH_INFO: `/v3/projects/dce9fe4bfdfe4e56a9373611bfdd03d0` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:19.886444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce9fe4bfdfe4e56a9373611bfdd03d0)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:19.888810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:20.018820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce9fe4bfdfe4e56a9373611bfdd03d0', 'request_id': 'req-c93cbe9b-c219-4c12-b8f8-e199c285949e'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:20.086456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce9fe4bfdfe4e56a9373611bfdd03d0', 'request_id': 'req-c93cbe9b-c219-4c12-b8f8-e199c285949e'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:20.093373 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce9fe4bfdfe4e56a9373611bfdd03d0', 'request_id': 'req-c93cbe9b-c219-4c12-b8f8-e199c285949e'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:20.103890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] The token cache is being invalidate because project dce9fe4bfdfe4e56a9373611bfdd03d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:18:20.104174 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:20.104801 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:20.106298 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1108/2215] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:19 2022] DELETE /identity/v3/projects/dce9fe4bfdfe4e56a9373611bfdd03d0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:18:20.110549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a165eeb-1d5a-4983-a7a4-54ddf6361d55 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:20.120302 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a165eeb-1d5a-4983-a7a4-54ddf6361d55 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:20.176759 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be555669-42f3-40a3-90c7-4a93f6a2b599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:20.177414 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be555669-42f3-40a3-90c7-4a93f6a2b599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:20.177689 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be555669-42f3-40a3-90c7-4a93f6a2b599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:20.177955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be555669-42f3-40a3-90c7-4a93f6a2b599 admin admin] PATH_INFO: `/v3/users/8afe4f6d10a94e1ab4a013cd23399cbd` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:20.179066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be555669-42f3-40a3-90c7-4a93f6a2b599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8afe4f6d10a94e1ab4a013cd23399cbd)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:20.181204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be555669-42f3-40a3-90c7-4a93f6a2b599 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:20.357345 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-be555669-42f3-40a3-90c7-4a93f6a2b599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8afe4f6d10a94e1ab4a013cd23399cbd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:20.358013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-be555669-42f3-40a3-90c7-4a93f6a2b599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8afe4f6d10a94e1ab4a013cd23399cbd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:20.365163 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-be555669-42f3-40a3-90c7-4a93f6a2b599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8afe4f6d10a94e1ab4a013cd23399cbd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:20.434500 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-be555669-42f3-40a3-90c7-4a93f6a2b599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8afe4f6d10a94e1ab4a013cd23399cbd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:20.447327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-be555669-42f3-40a3-90c7-4a93f6a2b599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8afe4f6d10a94e1ab4a013cd23399cbd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:20.453219 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1108/2216] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:18:20 2022] DELETE /identity/v3/users/8afe4f6d10a94e1ab4a013cd23399cbd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:20.914909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:20.916442 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:20.930540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cbe9b-c219-4c12-b8f8-e199c285949e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:20.989403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbdc90-a11c-4097-9322-05fc014d70df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:20.990070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbdc90-a11c-4097-9322-05fc014d70df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:20.990345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbdc90-a11c-4097-9322-05fc014d70df admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:20.990614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbdc90-a11c-4097-9322-05fc014d70df admin admin] PATH_INFO: `/v3/projects/3664ce53baa94e62a3d6c3931e7fba4d` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:20.991762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbdc90-a11c-4097-9322-05fc014d70df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3664ce53baa94e62a3d6c3931e7fba4d)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:20.993729 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbdc90-a11c-4097-9322-05fc014d70df admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:21.010242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:21.139526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-63fbdc90-a11c-4097-9322-05fc014d70df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3664ce53baa94e62a3d6c3931e7fba4d', 'request_id': 'req-63fbdc90-a11c-4097-9322-05fc014d70df'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:21.264097 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-63fbdc90-a11c-4097-9322-05fc014d70df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3664ce53baa94e62a3d6c3931e7fba4d', 'request_id': 'req-63fbdc90-a11c-4097-9322-05fc014d70df'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:21.271317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-63fbdc90-a11c-4097-9322-05fc014d70df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3664ce53baa94e62a3d6c3931e7fba4d', 'request_id': 'req-63fbdc90-a11c-4097-9322-05fc014d70df'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:21.282623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-63fbdc90-a11c-4097-9322-05fc014d70df admin admin] The token cache is being invalidate because project 3664ce53baa94e62a3d6c3931e7fba4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:18:21.282909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-63fbdc90-a11c-4097-9322-05fc014d70df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:21.283644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-63fbdc90-a11c-4097-9322-05fc014d70df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:21.285217 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1109/2217] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:20 2022] DELETE /identity/v3/projects/3664ce53baa94e62a3d6c3931e7fba4d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:21.290271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e699-07e8-41ed-965a-3ba1e5c28bf2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:21.290834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e699-07e8-41ed-965a-3ba1e5c28bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:21.291501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e699-07e8-41ed-965a-3ba1e5c28bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:21.312262 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1cd1e699-07e8-41ed-965a-3ba1e5c28bf2 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:21.313650 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1cd1e699-07e8-41ed-965a-3ba1e5c28bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:21.360927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:21.376625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1109/2218] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:21.384777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e67ac-8bee-480d-8cde-d8e8bc9b5473 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:21.385123 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e67ac-8bee-480d-8cde-d8e8bc9b5473 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:21.385504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e67ac-8bee-480d-8cde-d8e8bc9b5473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:21.406888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-4e0e67ac-8bee-480d-8cde-d8e8bc9b5473 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:21.408081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-4e0e67ac-8bee-480d-8cde-d8e8bc9b5473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:21.416137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1110/2219] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:21.420570 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1e699-07e8-41ed-965a-3ba1e5c28bf2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:21.430633 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1e699-07e8-41ed-965a-3ba1e5c28bf2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:21.435279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea6629-9f96-40ac-917d-d42b4a85cf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:21.435884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea6629-9f96-40ac-917d-d42b4a85cf7d admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:21.436164 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea6629-9f96-40ac-917d-d42b4a85cf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:21.436438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea6629-9f96-40ac-917d-d42b4a85cf7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:21.437118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea6629-9f96-40ac-917d-d42b4a85cf7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:18:21.437457 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea6629-9f96-40ac-917d-d42b4a85cf7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:21.440417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea6629-9f96-40ac-917d-d42b4a85cf7d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:21.451395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1110/2220] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:18:21.456409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e67ac-8bee-480d-8cde-d8e8bc9b5473 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:21.466122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e67ac-8bee-480d-8cde-d8e8bc9b5473 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:21.471689 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8455258-2695-4bf5-8a1a-14840ce638f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:21.472281 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8455258-2695-4bf5-8a1a-14840ce638f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:21.472559 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8455258-2695-4bf5-8a1a-14840ce638f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:21.472829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8455258-2695-4bf5-8a1a-14840ce638f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:21.473609 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8455258-2695-4bf5-8a1a-14840ce638f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:21.475488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8455258-2695-4bf5-8a1a-14840ce638f4 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:21.573666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1111/2221] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:21 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:21.578369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea6629-9f96-40ac-917d-d42b4a85cf7d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:21.588359 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea6629-9f96-40ac-917d-d42b4a85cf7d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:21.644408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18df54a-e5d1-43b6-934d-28cc1c6dfe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:21.645005 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18df54a-e5d1-43b6-934d-28cc1c6dfe92 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:21.645532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18df54a-e5d1-43b6-934d-28cc1c6dfe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:21.645821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18df54a-e5d1-43b6-934d-28cc1c6dfe92 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:21.646473 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18df54a-e5d1-43b6-934d-28cc1c6dfe92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:21.648524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18df54a-e5d1-43b6-934d-28cc1c6dfe92 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:21.732987 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1111/2222] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:21 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:21.737083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8455258-2695-4bf5-8a1a-14840ce638f4 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:21.747773 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8455258-2695-4bf5-8a1a-14840ce638f4 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:21.752476 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ce7de-00cf-4966-9497-3896fcd548f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:21.753061 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ce7de-00cf-4966-9497-3896fcd548f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:21.753374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ce7de-00cf-4966-9497-3896fcd548f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:21.753645 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ce7de-00cf-4966-9497-3896fcd548f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:21.754292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ce7de-00cf-4966-9497-3896fcd548f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:21.755880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ce7de-00cf-4966-9497-3896fcd548f6 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:21.766047 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1112/2223] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:21.770096 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18df54a-e5d1-43b6-934d-28cc1c6dfe92 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:21.781118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18df54a-e5d1-43b6-934d-28cc1c6dfe92 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:21.785949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7cc30-e517-4ac7-82d5-d302bfaf21bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:21.786559 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7cc30-e517-4ac7-82d5-d302bfaf21bf admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:21.786842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7cc30-e517-4ac7-82d5-d302bfaf21bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:21.787220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7cc30-e517-4ac7-82d5-d302bfaf21bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:21.787917 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7cc30-e517-4ac7-82d5-d302bfaf21bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:21.789576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7cc30-e517-4ac7-82d5-d302bfaf21bf admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:21.801683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1112/2224] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:21.806069 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ce7de-00cf-4966-9497-3896fcd548f6 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:21.816216 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ce7de-00cf-4966-9497-3896fcd548f6 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:21.820933 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b56a-01c9-4580-ba68-ea8846cf6610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:21.821622 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b56a-01c9-4580-ba68-ea8846cf6610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:21.822194 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b56a-01c9-4580-ba68-ea8846cf6610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:21.822194 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b56a-01c9-4580-ba68-ea8846cf6610 admin admin] PATH_INFO: `/v3/projects/7a26f85730a64244afd9f8c5761cfbe3/users/2ae08d4b528c453eb36c282f30245b99/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:21.839449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72b56a-01c9-4580-ba68-ea8846cf6610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a26f85730a64244afd9f8c5761cfbe3, user_id=2ae08d4b528c453eb36c282f30245b99, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:21.840509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72b56a-01c9-4580-ba68-ea8846cf6610 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:21.930880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1113/2225] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:21 2022] PUT /identity/v3/projects/7a26f85730a64244afd9f8c5761cfbe3/users/2ae08d4b528c453eb36c282f30245b99/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:21.942294 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f37f8b-369c-4c06-bf45-a21876b23e90 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:21.942567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f37f8b-369c-4c06-bf45-a21876b23e90 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:21.942833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f37f8b-369c-4c06-bf45-a21876b23e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:21.971403 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b8f37f8b-369c-4c06-bf45-a21876b23e90 None None] MFA Rules not processed for user `2ae08d4b528c453eb36c282f30245b99`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:21.972527 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b8f37f8b-369c-4c06-bf45-a21876b23e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:22.036875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1113/2226] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:22.041303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b56a-01c9-4580-ba68-ea8846cf6610 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:22.103838 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b56a-01c9-4580-ba68-ea8846cf6610 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:22.108768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedbb5c-ee62-4ace-ac13-594bfa020e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:22.109393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedbb5c-ee62-4ace-ac13-594bfa020e78 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:22.109674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedbb5c-ee62-4ace-ac13-594bfa020e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:22.109946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedbb5c-ee62-4ace-ac13-594bfa020e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:22.110586 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedbb5c-ee62-4ace-ac13-594bfa020e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:22.112546 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedbb5c-ee62-4ace-ac13-594bfa020e78 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:22.202736 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1114/2227] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:22 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:22.206820 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f37f8b-369c-4c06-bf45-a21876b23e90 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:22.218311 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f37f8b-369c-4c06-bf45-a21876b23e90 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:22.259070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:22.274046 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60465e-38cd-4353-85ec-e039f35aaf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:22.274877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60465e-38cd-4353-85ec-e039f35aaf0e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:22.274983 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60465e-38cd-4353-85ec-e039f35aaf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:22.275214 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60465e-38cd-4353-85ec-e039f35aaf0e admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:22.275862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60465e-38cd-4353-85ec-e039f35aaf0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:22.277775 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60465e-38cd-4353-85ec-e039f35aaf0e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:22.384036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1114/2228] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:22 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:18:22.387539 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedbb5c-ee62-4ace-ac13-594bfa020e78 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:22.398735 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedbb5c-ee62-4ace-ac13-594bfa020e78 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:22.403649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea612f1-79f4-416b-9ef7-fe64952f908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:22.407064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea612f1-79f4-416b-9ef7-fe64952f908f admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:22.407064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea612f1-79f4-416b-9ef7-fe64952f908f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:22.407064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea612f1-79f4-416b-9ef7-fe64952f908f admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:22.407064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea612f1-79f4-416b-9ef7-fe64952f908f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:22.407064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea612f1-79f4-416b-9ef7-fe64952f908f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:22.417617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1115/2229] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:22.421783 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60465e-38cd-4353-85ec-e039f35aaf0e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:22.431979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60465e-38cd-4353-85ec-e039f35aaf0e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:22.437045 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f871453-d706-4225-9a6f-888f7f1d64fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:22.437718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f871453-d706-4225-9a6f-888f7f1d64fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:22.437999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f871453-d706-4225-9a6f-888f7f1d64fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:22.438270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f871453-d706-4225-9a6f-888f7f1d64fa admin admin] PATH_INFO: `/v3/projects/d4b50944b55e4c5c89c91c22471bb883/users/9199cb4ad6b94a3aa6eb70342b71b3e8/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:22.453438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f871453-d706-4225-9a6f-888f7f1d64fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b50944b55e4c5c89c91c22471bb883, user_id=9199cb4ad6b94a3aa6eb70342b71b3e8, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:22.456102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f871453-d706-4225-9a6f-888f7f1d64fa admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:22.525877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1115/2230] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:22 2022] PUT /identity/v3/projects/d4b50944b55e4c5c89c91c22471bb883/users/9199cb4ad6b94a3aa6eb70342b71b3e8/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:22.529973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea612f1-79f4-416b-9ef7-fe64952f908f admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:22.540321 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea612f1-79f4-416b-9ef7-fe64952f908f admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:22.549403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:22.596543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dcb12-e2c4-43e2-aaa5-90c706a7b33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:22.597190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dcb12-e2c4-43e2-aaa5-90c706a7b33d admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:22.597503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dcb12-e2c4-43e2-aaa5-90c706a7b33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:22.597776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dcb12-e2c4-43e2-aaa5-90c706a7b33d admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:22.598411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60dcb12-e2c4-43e2-aaa5-90c706a7b33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:22.600063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60dcb12-e2c4-43e2-aaa5-90c706a7b33d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:22.610413 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1116/2231] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:22.614566 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f871453-d706-4225-9a6f-888f7f1d64fa admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:22.625678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f871453-d706-4225-9a6f-888f7f1d64fa admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:22.630531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363bb6f-fb3d-4b8f-a191-b99543d13c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:22.631183 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363bb6f-fb3d-4b8f-a191-b99543d13c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:22.631458 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363bb6f-fb3d-4b8f-a191-b99543d13c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:22.631727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363bb6f-fb3d-4b8f-a191-b99543d13c97 admin admin] PATH_INFO: `/v3/projects/d4b50944b55e4c5c89c91c22471bb883/users/9199cb4ad6b94a3aa6eb70342b71b3e8/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:22.633753 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363bb6f-fb3d-4b8f-a191-b99543d13c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b50944b55e4c5c89c91c22471bb883, user_id=9199cb4ad6b94a3aa6eb70342b71b3e8, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:22.636430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363bb6f-fb3d-4b8f-a191-b99543d13c97 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:22.647424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1116/2232] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:22 2022] PUT /identity/v3/projects/d4b50944b55e4c5c89c91c22471bb883/users/9199cb4ad6b94a3aa6eb70342b71b3e8/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:22.657659 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69921948-5697-4d1e-95ce-804d34fc0cfc None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:22.657939 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69921948-5697-4d1e-95ce-804d34fc0cfc None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:22.658209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69921948-5697-4d1e-95ce-804d34fc0cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:22.688553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-69921948-5697-4d1e-95ce-804d34fc0cfc None None] MFA Rules not processed for user `9199cb4ad6b94a3aa6eb70342b71b3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:22.689873 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-69921948-5697-4d1e-95ce-804d34fc0cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:22.763440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1117/2233] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:22.775468 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363bb6f-fb3d-4b8f-a191-b99543d13c97 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:22.777725 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8363bb6f-fb3d-4b8f-a191-b99543d13c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:22.838996 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363bb6f-fb3d-4b8f-a191-b99543d13c97 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:22.843510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb5b3f-2c71-480d-9f95-94c47268305e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:22.844109 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb5b3f-2c71-480d-9f95-94c47268305e service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:22.844481 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb5b3f-2c71-480d-9f95-94c47268305e service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:22.844757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb5b3f-2c71-480d-9f95-94c47268305e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:22.900397 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb5b3f-2c71-480d-9f95-94c47268305e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:22.901928 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb5b3f-2c71-480d-9f95-94c47268305e service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:22.911064 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1117/2234] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:24.729520 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69921948-5697-4d1e-95ce-804d34fc0cfc None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:24.740077 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69921948-5697-4d1e-95ce-804d34fc0cfc None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:24.743776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff40834-4ec1-4327-a1f6-b34e4b8767d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:24.744366 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40834-4ec1-4327-a1f6-b34e4b8767d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:24.744640 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40834-4ec1-4327-a1f6-b34e4b8767d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:24.744906 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff40834-4ec1-4327-a1f6-b34e4b8767d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:24.753846 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff40834-4ec1-4327-a1f6-b34e4b8767d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:24.755251 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff40834-4ec1-4327-a1f6-b34e4b8767d4 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:24.764557 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1118/2235] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:29.162146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb5b3f-2c71-480d-9f95-94c47268305e service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:29.213702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:29.225136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb5b3f-2c71-480d-9f95-94c47268305e service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:29.229699 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:29.230312 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:29.230586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:29.230855 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] PATH_INFO: `/v3/users/2ae08d4b528c453eb36c282f30245b99` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:29.231948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae08d4b528c453eb36c282f30245b99)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:29.234068 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:29.444410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae08d4b528c453eb36c282f30245b99'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:29.445042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae08d4b528c453eb36c282f30245b99'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:29.452639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae08d4b528c453eb36c282f30245b99'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:29.543479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae08d4b528c453eb36c282f30245b99'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:29.557574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae08d4b528c453eb36c282f30245b99'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:29.565392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1118/2236] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:18:29 2022] DELETE /identity/v3/users/2ae08d4b528c453eb36c282f30245b99 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:29.569794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646c0c4-4336-4aef-b03f-453e52160335 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:29.570303 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646c0c4-4336-4aef-b03f-453e52160335 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:29.570422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646c0c4-4336-4aef-b03f-453e52160335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:29.590349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-2646c0c4-4336-4aef-b03f-453e52160335 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:29.591556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2646c0c4-4336-4aef-b03f-453e52160335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:29.651712 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1119/2237] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:29.662231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:29.663635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:29.725191 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa0790-df49-478a-a97f-ca0fb1bd4395 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:29.728946 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f7960-3e58-48f1-a8a0-3fe1c5cad728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:29.729692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f7960-3e58-48f1-a8a0-3fe1c5cad728 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:29.730069 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f7960-3e58-48f1-a8a0-3fe1c5cad728 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:29.730501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f7960-3e58-48f1-a8a0-3fe1c5cad728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:29.740115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f7960-3e58-48f1-a8a0-3fe1c5cad728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:29.741710 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f7960-3e58-48f1-a8a0-3fe1c5cad728 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:29.751876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1119/2238] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:30.225437 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646c0c4-4336-4aef-b03f-453e52160335 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:30.226906 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2646c0c4-4336-4aef-b03f-453e52160335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:30.240457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646c0c4-4336-4aef-b03f-453e52160335 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:30.245083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:30.245738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:30.246019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:30.246767 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] PATH_INFO: `/v3/projects/7a26f85730a64244afd9f8c5761cfbe3` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:30.248892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a26f85730a64244afd9f8c5761cfbe3)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:30.251154 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:30.268300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:30.391007 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a26f85730a64244afd9f8c5761cfbe3', 'request_id': 'req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:30.513921 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a26f85730a64244afd9f8c5761cfbe3', 'request_id': 'req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:30.520439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a26f85730a64244afd9f8c5761cfbe3', 'request_id': 'req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:30.531443 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] The token cache is being invalidate because project 7a26f85730a64244afd9f8c5761cfbe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:18:30.531723 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:30.532365 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:30.533844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1120/2239] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:30 2022] DELETE /identity/v3/projects/7a26f85730a64244afd9f8c5761cfbe3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:30.537969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f7960-3e58-48f1-a8a0-3fe1c5cad728 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:30.548410 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f7960-3e58-48f1-a8a0-3fe1c5cad728 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:30.603979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1283dd-516c-4c0a-a660-55935e3abf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:30.604588 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1283dd-516c-4c0a-a660-55935e3abf1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:30.606424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1283dd-516c-4c0a-a660-55935e3abf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:30.606424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1283dd-516c-4c0a-a660-55935e3abf1b admin admin] PATH_INFO: `/v3/users/9199cb4ad6b94a3aa6eb70342b71b3e8` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:30.606424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1283dd-516c-4c0a-a660-55935e3abf1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9199cb4ad6b94a3aa6eb70342b71b3e8)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:30.608859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1283dd-516c-4c0a-a660-55935e3abf1b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:30.622070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:30.814428 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7d1283dd-516c-4c0a-a660-55935e3abf1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9199cb4ad6b94a3aa6eb70342b71b3e8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:30.815072 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7d1283dd-516c-4c0a-a660-55935e3abf1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9199cb4ad6b94a3aa6eb70342b71b3e8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:30.822089 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7d1283dd-516c-4c0a-a660-55935e3abf1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9199cb4ad6b94a3aa6eb70342b71b3e8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:30.908710 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7d1283dd-516c-4c0a-a660-55935e3abf1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9199cb4ad6b94a3aa6eb70342b71b3e8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:30.921183 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7d1283dd-516c-4c0a-a660-55935e3abf1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9199cb4ad6b94a3aa6eb70342b71b3e8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:30.927162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1120/2240] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:18:30 2022] DELETE /identity/v3/users/9199cb4ad6b94a3aa6eb70342b71b3e8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:31.414005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:31.415481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:31.432508 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518ee0d-6b5e-43a8-a6d7-1173ec81dd8e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:31.496584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:31.497213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:31.497521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:31.497794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc admin admin] PATH_INFO: `/v3/projects/d4b50944b55e4c5c89c91c22471bb883` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:31.499435 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b50944b55e4c5c89c91c22471bb883)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:31.501364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:31.612953 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b50944b55e4c5c89c91c22471bb883', 'request_id': 'req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:31.691642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b50944b55e4c5c89c91c22471bb883', 'request_id': 'req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:31.697992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b50944b55e4c5c89c91c22471bb883', 'request_id': 'req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:31.709330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc admin admin] The token cache is being invalidate because project d4b50944b55e4c5c89c91c22471bb883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:18:31.709642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:31.710270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-17bcaff3-bfc1-4a2d-8c73-0b17bee335fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:31.711742 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1121/2241] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:31 2022] DELETE /identity/v3/projects/d4b50944b55e4c5c89c91c22471bb883 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:31.716656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3499b6e-5afc-473e-a52f-d21d8c64b529 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:31.717116 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3499b6e-5afc-473e-a52f-d21d8c64b529 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:31.717227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3499b6e-5afc-473e-a52f-d21d8c64b529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:31.737129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e3499b6e-5afc-473e-a52f-d21d8c64b529 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:31.738346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e3499b6e-5afc-473e-a52f-d21d8c64b529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:31.796647 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1121/2242] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:31.804800 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9137d-6fef-4798-a7cf-4f168e163c26 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:31.805094 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9137d-6fef-4798-a7cf-4f168e163c26 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:31.805418 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9137d-6fef-4798-a7cf-4f168e163c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:31.825610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-dfa9137d-6fef-4798-a7cf-4f168e163c26 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:31.826871 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-dfa9137d-6fef-4798-a7cf-4f168e163c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:31.834824 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1122/2243] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:31.838924 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3499b6e-5afc-473e-a52f-d21d8c64b529 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:31.848768 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3499b6e-5afc-473e-a52f-d21d8c64b529 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:31.853432 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df021cc6-bdef-462c-af51-baab77ec6681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:31.856945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df021cc6-bdef-462c-af51-baab77ec6681 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:31.856945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df021cc6-bdef-462c-af51-baab77ec6681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:31.856945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df021cc6-bdef-462c-af51-baab77ec6681 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:31.856945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df021cc6-bdef-462c-af51-baab77ec6681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:18:31.856945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df021cc6-bdef-462c-af51-baab77ec6681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:31.857948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df021cc6-bdef-462c-af51-baab77ec6681 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:31.869308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1122/2244] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:18:31.874343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9137d-6fef-4798-a7cf-4f168e163c26 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:31.883548 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9137d-6fef-4798-a7cf-4f168e163c26 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:31.888232 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1674f-8dc3-4365-87cd-13a28bfe8eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:31.888857 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1674f-8dc3-4365-87cd-13a28bfe8eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:31.889223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1674f-8dc3-4365-87cd-13a28bfe8eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:31.889545 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1674f-8dc3-4365-87cd-13a28bfe8eb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:31.890235 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1674f-8dc3-4365-87cd-13a28bfe8eb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:31.892121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1674f-8dc3-4365-87cd-13a28bfe8eb4 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:32.013912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1123/2245] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:31 2022] POST /identity/v3/projects => generated 359 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:32.018244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df021cc6-bdef-462c-af51-baab77ec6681 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:32.028223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df021cc6-bdef-462c-af51-baab77ec6681 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:32.084189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00dbed-f0de-4c30-b0a4-2f08bc521be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:32.084788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00dbed-f0de-4c30-b0a4-2f08bc521be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:32.085074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00dbed-f0de-4c30-b0a4-2f08bc521be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:32.085375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00dbed-f0de-4c30-b0a4-2f08bc521be6 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:32.086001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00dbed-f0de-4c30-b0a4-2f08bc521be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:32.087908 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00dbed-f0de-4c30-b0a4-2f08bc521be6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:32.189698 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1123/2246] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:32 2022] POST /identity/v3/users => generated 280 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:32.193565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1674f-8dc3-4365-87cd-13a28bfe8eb4 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:32.204108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1674f-8dc3-4365-87cd-13a28bfe8eb4 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:32.208856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7b283-e3d9-4bb5-a924-42d7482d6017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:32.209512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7b283-e3d9-4bb5-a924-42d7482d6017 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:32.209804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7b283-e3d9-4bb5-a924-42d7482d6017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:32.210055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7b283-e3d9-4bb5-a924-42d7482d6017 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:32.210739 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7b283-e3d9-4bb5-a924-42d7482d6017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:32.212321 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7b283-e3d9-4bb5-a924-42d7482d6017 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:32.213569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:32.223443 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1124/2247] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:32.230106 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00dbed-f0de-4c30-b0a4-2f08bc521be6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:32.240800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00dbed-f0de-4c30-b0a4-2f08bc521be6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:32.245440 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f81962-4af8-4820-abcc-63a1c96e349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:32.246035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81962-4af8-4820-abcc-63a1c96e349a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:32.250581 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81962-4af8-4820-abcc-63a1c96e349a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:32.250581 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81962-4af8-4820-abcc-63a1c96e349a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:32.250581 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f81962-4af8-4820-abcc-63a1c96e349a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:32.250581 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f81962-4af8-4820-abcc-63a1c96e349a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:32.251236 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:32.260026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1124/2248] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:32.264417 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7b283-e3d9-4bb5-a924-42d7482d6017 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:32.274957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7b283-e3d9-4bb5-a924-42d7482d6017 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:32.280141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c5e52-8ee7-4ae5-ac00-bc62aa189cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:32.280812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c5e52-8ee7-4ae5-ac00-bc62aa189cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:32.281086 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c5e52-8ee7-4ae5-ac00-bc62aa189cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:32.281395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c5e52-8ee7-4ae5-ac00-bc62aa189cf4 admin admin] PATH_INFO: `/v3/projects/58f1d811df5f40778a73b4c5d84a838c/users/0a74598bac9147e7a9fa52238b790873/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:32.296429 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c5e52-8ee7-4ae5-ac00-bc62aa189cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f1d811df5f40778a73b4c5d84a838c, user_id=0a74598bac9147e7a9fa52238b790873, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:32.299096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c5e52-8ee7-4ae5-ac00-bc62aa189cf4 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:32.366313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1125/2249] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:32 2022] PUT /identity/v3/projects/58f1d811df5f40778a73b4c5d84a838c/users/0a74598bac9147e7a9fa52238b790873/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:32.378270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8d70d-7c6e-43db-b427-86b24c25f44b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:32.378556 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8d70d-7c6e-43db-b427-86b24c25f44b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:32.378831 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8d70d-7c6e-43db-b427-86b24c25f44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:32.408272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-faf8d70d-7c6e-43db-b427-86b24c25f44b None None] MFA Rules not processed for user `0a74598bac9147e7a9fa52238b790873`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:32.409511 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-faf8d70d-7c6e-43db-b427-86b24c25f44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:32.475266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1125/2250] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:32.509173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c5e52-8ee7-4ae5-ac00-bc62aa189cf4 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:32.510953 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b73c5e52-8ee7-4ae5-ac00-bc62aa189cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:32.572187 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c5e52-8ee7-4ae5-ac00-bc62aa189cf4 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:32.579105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438571e-63a1-417a-9174-5a310e23d3fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:32.579105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438571e-63a1-417a-9174-5a310e23d3fb service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:32.579105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438571e-63a1-417a-9174-5a310e23d3fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:32.579105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438571e-63a1-417a-9174-5a310e23d3fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:32.590486 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438571e-63a1-417a-9174-5a310e23d3fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:32.592508 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438571e-63a1-417a-9174-5a310e23d3fb service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:32.601816 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1126/2251] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:32 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:32.618617 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8d70d-7c6e-43db-b427-86b24c25f44b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:32.684617 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8d70d-7c6e-43db-b427-86b24c25f44b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:32.689834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:32.690548 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:32.690833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:32.691099 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] PATH_INFO: `/v3/users/0a74598bac9147e7a9fa52238b790873` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:32.692389 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a74598bac9147e7a9fa52238b790873)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:32.694406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:32.912568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a74598bac9147e7a9fa52238b790873'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:32.913389 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a74598bac9147e7a9fa52238b790873'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:32.921330 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a74598bac9147e7a9fa52238b790873'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:33.017968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a74598bac9147e7a9fa52238b790873'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:33.031633 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a74598bac9147e7a9fa52238b790873'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:33.037599 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1126/2252] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:18:32 2022] DELETE /identity/v3/users/0a74598bac9147e7a9fa52238b790873 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:33.042292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a9e15-d050-4cb7-9c8e-eac6039262d2 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:33.042575 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a9e15-d050-4cb7-9c8e-eac6039262d2 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:33.042844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a9e15-d050-4cb7-9c8e-eac6039262d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:33.062458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d22a9e15-d050-4cb7-9c8e-eac6039262d2 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:33.066644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d22a9e15-d050-4cb7-9c8e-eac6039262d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:33.122079 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1127/2253] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:33.132018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:33.133440 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:33.143880 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:33.191363 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050e485-e650-4777-9350-210c3c459a9b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:33.195287 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d9c4f-8ebb-43c5-8966-0f8404825a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:33.195894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d9c4f-8ebb-43c5-8966-0f8404825a23 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:33.201750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d9c4f-8ebb-43c5-8966-0f8404825a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:33.201750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d9c4f-8ebb-43c5-8966-0f8404825a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:33.206223 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d9c4f-8ebb-43c5-8966-0f8404825a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:33.207648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d9c4f-8ebb-43c5-8966-0f8404825a23 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:33.217703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1127/2254] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:33.754753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a9e15-d050-4cb7-9c8e-eac6039262d2 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:33.756243 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d22a9e15-d050-4cb7-9c8e-eac6039262d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:33.768483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a9e15-d050-4cb7-9c8e-eac6039262d2 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:33.774780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:33.774780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:33.774780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:33.774780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056 admin admin] PATH_INFO: `/v3/projects/58f1d811df5f40778a73b4c5d84a838c` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:33.775832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f1d811df5f40778a73b4c5d84a838c)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:33.777771 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:33.903880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f1d811df5f40778a73b4c5d84a838c', 'request_id': 'req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:34.034409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f1d811df5f40778a73b4c5d84a838c', 'request_id': 'req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:34.040310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f1d811df5f40778a73b4c5d84a838c', 'request_id': 'req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:34.042175 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d9c4f-8ebb-43c5-8966-0f8404825a23 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:34.043851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-168d9c4f-8ebb-43c5-8966-0f8404825a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:34.048746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:34.053596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056 admin admin] The token cache is being invalidate because project 58f1d811df5f40778a73b4c5d84a838c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:18:34.054928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:34.055666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-0e27ea9d-691f-4bc3-85b8-927f5f7c7056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:34.057487 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1128/2255] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:33 2022] DELETE /identity/v3/projects/58f1d811df5f40778a73b4c5d84a838c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:34.057776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d9c4f-8ebb-43c5-8966-0f8404825a23 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:34.062198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098e023-4684-4926-9369-eebc55872707 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:34.062481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098e023-4684-4926-9369-eebc55872707 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:34.062752 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098e023-4684-4926-9369-eebc55872707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:34.084562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-7098e023-4684-4926-9369-eebc55872707 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:34.085835 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7098e023-4684-4926-9369-eebc55872707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:34.110193 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8606f5-759b-47a3-bfd5-874c5a5c6ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:34.110797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8606f5-759b-47a3-bfd5-874c5a5c6ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:34.111077 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8606f5-759b-47a3-bfd5-874c5a5c6ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:34.111380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8606f5-759b-47a3-bfd5-874c5a5c6ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:34.113226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4b8606f5-759b-47a3-bfd5-874c5a5c6ea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:34.145772 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1129/2256] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:18:34.153404 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9342c4-3542-4adb-87fc-fa3f9745a209 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:34.154903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9342c4-3542-4adb-87fc-fa3f9745a209 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:34.154903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9342c4-3542-4adb-87fc-fa3f9745a209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:34.174229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-af9342c4-3542-4adb-87fc-fa3f9745a209 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:34.175467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-af9342c4-3542-4adb-87fc-fa3f9745a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:34.184071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1130/2257] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:18:34.185251 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8606f5-759b-47a3-bfd5-874c5a5c6ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:34.187480 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8606f5-759b-47a3-bfd5-874c5a5c6ea6 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:34.188918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9342c4-3542-4adb-87fc-fa3f9745a209 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:34.198127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9342c4-3542-4adb-87fc-fa3f9745a209 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:34.198836 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1128/2258] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:18:34.203009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb32fb-b5c6-488d-aa54-54f45690a532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:34.203639 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb32fb-b5c6-488d-aa54-54f45690a532 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:34.203915 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb32fb-b5c6-488d-aa54-54f45690a532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:34.204192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb32fb-b5c6-488d-aa54-54f45690a532 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:34.204836 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb32fb-b5c6-488d-aa54-54f45690a532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:18:34.205142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb32fb-b5c6-488d-aa54-54f45690a532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:34.206778 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb32fb-b5c6-488d-aa54-54f45690a532 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:34.219242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1131/2259] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:18:34.223578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8606f5-759b-47a3-bfd5-874c5a5c6ea6 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:34.233574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8606f5-759b-47a3-bfd5-874c5a5c6ea6 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:34.240347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edde9c-3f6d-4561-970b-cda03a90edc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:34.240957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edde9c-3f6d-4561-970b-cda03a90edc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:34.241355 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edde9c-3f6d-4561-970b-cda03a90edc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:34.241662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edde9c-3f6d-4561-970b-cda03a90edc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:34.246757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edde9c-3f6d-4561-970b-cda03a90edc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:34.246757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edde9c-3f6d-4561-970b-cda03a90edc6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:34.363990 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1129/2260] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:34 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:34.373405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb32fb-b5c6-488d-aa54-54f45690a532 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:34.384107 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb32fb-b5c6-488d-aa54-54f45690a532 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:34.445643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298c909-8e43-4e6d-bdcf-1e9eeb92ec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:34.446595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298c909-8e43-4e6d-bdcf-1e9eeb92ec47 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:34.446867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298c909-8e43-4e6d-bdcf-1e9eeb92ec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:34.447132 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298c909-8e43-4e6d-bdcf-1e9eeb92ec47 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:34.447761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298c909-8e43-4e6d-bdcf-1e9eeb92ec47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:34.449755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298c909-8e43-4e6d-bdcf-1e9eeb92ec47 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:34.587704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1132/2261] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:34 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:34.589123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edde9c-3f6d-4561-970b-cda03a90edc6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:34.600173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edde9c-3f6d-4561-970b-cda03a90edc6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:34.604600 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3c597-2c1d-4cfd-bf4d-aa1e734c023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:34.605214 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3c597-2c1d-4cfd-bf4d-aa1e734c023b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:34.605530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3c597-2c1d-4cfd-bf4d-aa1e734c023b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:34.605800 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3c597-2c1d-4cfd-bf4d-aa1e734c023b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:34.606434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3c597-2c1d-4cfd-bf4d-aa1e734c023b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:34.608198 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3c597-2c1d-4cfd-bf4d-aa1e734c023b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:34.621945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1130/2262] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:34.623324 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298c909-8e43-4e6d-bdcf-1e9eeb92ec47 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:34.633606 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298c909-8e43-4e6d-bdcf-1e9eeb92ec47 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:34.638327 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a663a32-51f2-4cfb-8c40-b784b21a7ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:34.639606 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a663a32-51f2-4cfb-8c40-b784b21a7ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:34.639881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a663a32-51f2-4cfb-8c40-b784b21a7ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:34.640143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a663a32-51f2-4cfb-8c40-b784b21a7ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:34.640782 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a663a32-51f2-4cfb-8c40-b784b21a7ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:34.642430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a663a32-51f2-4cfb-8c40-b784b21a7ab0 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:34.653280 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1133/2263] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:34.658055 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3c597-2c1d-4cfd-bf4d-aa1e734c023b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:34.667794 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3c597-2c1d-4cfd-bf4d-aa1e734c023b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:34.673719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b711d-5dbd-4219-bfb9-f8c93b117365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:34.674367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b711d-5dbd-4219-bfb9-f8c93b117365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:34.674644 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b711d-5dbd-4219-bfb9-f8c93b117365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:34.674911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b711d-5dbd-4219-bfb9-f8c93b117365 admin admin] PATH_INFO: `/v3/projects/9489b5299f314fc3a5711391ecc693ba/users/1e0414cc9d674564ac8772aaa699be91/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:34.691007 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b711d-5dbd-4219-bfb9-f8c93b117365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9489b5299f314fc3a5711391ecc693ba, user_id=1e0414cc9d674564ac8772aaa699be91, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:34.693670 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b711d-5dbd-4219-bfb9-f8c93b117365 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:34.806073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1131/2264] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:34 2022] PUT /identity/v3/projects/9489b5299f314fc3a5711391ecc693ba/users/1e0414cc9d674564ac8772aaa699be91/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:34.818469 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634494b-bafd-45fb-9993-ecda6bed4e56 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:34.818974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634494b-bafd-45fb-9993-ecda6bed4e56 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:34.818974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634494b-bafd-45fb-9993-ecda6bed4e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:34.846630 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e634494b-bafd-45fb-9993-ecda6bed4e56 None None] MFA Rules not processed for user `1e0414cc9d674564ac8772aaa699be91`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:34.847766 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e634494b-bafd-45fb-9993-ecda6bed4e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:34.895743 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:34.917038 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1134/2265] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:18:34.928793 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b711d-5dbd-4219-bfb9-f8c93b117365 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:34.930829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3d1b711d-5dbd-4219-bfb9-f8c93b117365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:34.939013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:34.999313 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b711d-5dbd-4219-bfb9-f8c93b117365 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:35.003550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb96704-62ca-4c25-89db-06032b6395ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:35.007161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb96704-62ca-4c25-89db-06032b6395ca service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:35.007161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb96704-62ca-4c25-89db-06032b6395ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:35.007161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb96704-62ca-4c25-89db-06032b6395ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:35.013767 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb96704-62ca-4c25-89db-06032b6395ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:35.015314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb96704-62ca-4c25-89db-06032b6395ca service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:35.024590 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1132/2266] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:38.180083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634494b-bafd-45fb-9993-ecda6bed4e56 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:38.180786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e634494b-bafd-45fb-9993-ecda6bed4e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:38.248558 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634494b-bafd-45fb-9993-ecda6bed4e56 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:38.253205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040be6-77a4-48a2-88c0-474b0cfab782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:38.253866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040be6-77a4-48a2-88c0-474b0cfab782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:38.254144 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040be6-77a4-48a2-88c0-474b0cfab782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:38.254418 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040be6-77a4-48a2-88c0-474b0cfab782 admin admin] PATH_INFO: `/v3/users/093519cbc8564b859c01a3a3ab1aae3d` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:38.255533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a040be6-77a4-48a2-88c0-474b0cfab782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093519cbc8564b859c01a3a3ab1aae3d)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:38.257537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a040be6-77a4-48a2-88c0-474b0cfab782 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:38.293631 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb96704-62ca-4c25-89db-06032b6395ca service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:38.301327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb96704-62ca-4c25-89db-06032b6395ca service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:38.306266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:38.306892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:38.307171 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:38.307442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] PATH_INFO: `/v3/users/1e0414cc9d674564ac8772aaa699be91` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:38.308584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0414cc9d674564ac8772aaa699be91)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:38.310653 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:38.500401 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6a040be6-77a4-48a2-88c0-474b0cfab782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093519cbc8564b859c01a3a3ab1aae3d'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:38.500990 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6a040be6-77a4-48a2-88c0-474b0cfab782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093519cbc8564b859c01a3a3ab1aae3d'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:38.513038 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6a040be6-77a4-48a2-88c0-474b0cfab782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093519cbc8564b859c01a3a3ab1aae3d'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:38.514363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6a040be6-77a4-48a2-88c0-474b0cfab782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093519cbc8564b859c01a3a3ab1aae3d'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:38.621693 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6a040be6-77a4-48a2-88c0-474b0cfab782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093519cbc8564b859c01a3a3ab1aae3d'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:38.634468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1135/2267] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:18:38 2022] DELETE /identity/v3/users/093519cbc8564b859c01a3a3ab1aae3d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:38.636131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0414cc9d674564ac8772aaa699be91'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:38.636772 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0414cc9d674564ac8772aaa699be91'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:38.644748 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0414cc9d674564ac8772aaa699be91'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:38.730995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0414cc9d674564ac8772aaa699be91'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:38.744928 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0414cc9d674564ac8772aaa699be91'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:38.751463 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1133/2268] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:18:38 2022] DELETE /identity/v3/users/1e0414cc9d674564ac8772aaa699be91 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:18:38.755948 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74901b64-0ab5-453b-a648-d5ec1e3a40d2 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:38.756232 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74901b64-0ab5-453b-a648-d5ec1e3a40d2 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:38.756503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74901b64-0ab5-453b-a648-d5ec1e3a40d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:38.775563 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-74901b64-0ab5-453b-a648-d5ec1e3a40d2 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:38.776776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-74901b64-0ab5-453b-a648-d5ec1e3a40d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:38.837517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1136/2269] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:38.847562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:38.848949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:38.905578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1337ca5-8d5a-4287-b6fe-6f3746275f07 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:38.909186 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff383d-ba23-433f-b7f4-9ca1f74edb90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:38.909809 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff383d-ba23-433f-b7f4-9ca1f74edb90 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:38.910082 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff383d-ba23-433f-b7f4-9ca1f74edb90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:38.910347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff383d-ba23-433f-b7f4-9ca1f74edb90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:38.919383 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff383d-ba23-433f-b7f4-9ca1f74edb90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:38.921875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff383d-ba23-433f-b7f4-9ca1f74edb90 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:38.928278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74901b64-0ab5-453b-a648-d5ec1e3a40d2 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:38.933615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-74901b64-0ab5-453b-a648-d5ec1e3a40d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:38.934521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1134/2270] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:38.942465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74901b64-0ab5-453b-a648-d5ec1e3a40d2 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:38.947577 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:38.948709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:38.948709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:38.948920 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99 admin admin] PATH_INFO: `/v3/projects/85fa732ab7b64eaab79cfd43d9c2e898` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:38.950037 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85fa732ab7b64eaab79cfd43d9c2e898)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:38.952038 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:38.953760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:39.102920 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85fa732ab7b64eaab79cfd43d9c2e898', 'request_id': 'req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:39.172168 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85fa732ab7b64eaab79cfd43d9c2e898', 'request_id': 'req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:39.178910 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85fa732ab7b64eaab79cfd43d9c2e898', 'request_id': 'req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:39.190000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99 admin admin] The token cache is being invalidate because project 85fa732ab7b64eaab79cfd43d9c2e898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:18:39.190698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:39.191007 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-69d82308-2fdc-4d2d-82a3-4bade2f0bf99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:39.192528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1137/2271] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:38 2022] DELETE /identity/v3/projects/85fa732ab7b64eaab79cfd43d9c2e898 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:18:39.197442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dc793-3cbf-4eee-9cfa-dd478ceb0ea5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.197729 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dc793-3cbf-4eee-9cfa-dd478ceb0ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.198003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dc793-3cbf-4eee-9cfa-dd478ceb0ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.221337 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cf6dc793-3cbf-4eee-9cfa-dd478ceb0ea5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:39.222568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cf6dc793-3cbf-4eee-9cfa-dd478ceb0ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:39.236349 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:39.284601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1135/2272] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:39.292396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc03fc-f8b2-4245-880c-fc4b4f57ac88 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.292677 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc03fc-f8b2-4245-880c-fc4b4f57ac88 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.292948 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc03fc-f8b2-4245-880c-fc4b4f57ac88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.313960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-9efc03fc-f8b2-4245-880c-fc4b4f57ac88 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:39.315160 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9efc03fc-f8b2-4245-880c-fc4b4f57ac88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:39.323180 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1138/2273] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:39.328358 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dc793-3cbf-4eee-9cfa-dd478ceb0ea5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:39.337982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dc793-3cbf-4eee-9cfa-dd478ceb0ea5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:39.343879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3117d-57f8-46ca-9a2b-797624565a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:39.344614 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3117d-57f8-46ca-9a2b-797624565a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.344895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3117d-57f8-46ca-9a2b-797624565a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.345168 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3117d-57f8-46ca-9a2b-797624565a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.345892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3117d-57f8-46ca-9a2b-797624565a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:18:39.346197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3117d-57f8-46ca-9a2b-797624565a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:39.347816 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3117d-57f8-46ca-9a2b-797624565a28 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:39.360264 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1136/2274] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:18:39.364695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc03fc-f8b2-4245-880c-fc4b4f57ac88 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:39.374138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc03fc-f8b2-4245-880c-fc4b4f57ac88 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:39.378810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d05a-248e-42fe-84fc-30ba87bfcf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:39.379401 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d05a-248e-42fe-84fc-30ba87bfcf38 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.379677 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d05a-248e-42fe-84fc-30ba87bfcf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.379949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d05a-248e-42fe-84fc-30ba87bfcf38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.380590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d05a-248e-42fe-84fc-30ba87bfcf38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:39.382591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d05a-248e-42fe-84fc-30ba87bfcf38 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:39.425328 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3117d-57f8-46ca-9a2b-797624565a28 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:39.427088 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-91c3117d-57f8-46ca-9a2b-797624565a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:39.440813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3117d-57f8-46ca-9a2b-797624565a28 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:39.446458 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b56bc3-139a-48cc-ae41-110ada326e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:39.447111 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56bc3-139a-48cc-ae41-110ada326e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.447385 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56bc3-139a-48cc-ae41-110ada326e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.447656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56bc3-139a-48cc-ae41-110ada326e51 admin admin] PATH_INFO: `/v3/projects/9489b5299f314fc3a5711391ecc693ba` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.448805 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b56bc3-139a-48cc-ae41-110ada326e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9489b5299f314fc3a5711391ecc693ba)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:39.450766 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b56bc3-139a-48cc-ae41-110ada326e51 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:39.510663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1139/2275] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:39 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:39.515487 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d05a-248e-42fe-84fc-30ba87bfcf38 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:39.578662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d05a-248e-42fe-84fc-30ba87bfcf38 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:39.585450 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-17b56bc3-139a-48cc-ae41-110ada326e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9489b5299f314fc3a5711391ecc693ba', 'request_id': 'req-17b56bc3-139a-48cc-ae41-110ada326e51'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:39.634993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26feda-9954-4c2a-b223-43ca4f0fc488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:39.635596 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26feda-9954-4c2a-b223-43ca4f0fc488 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.635920 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26feda-9954-4c2a-b223-43ca4f0fc488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.636170 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26feda-9954-4c2a-b223-43ca4f0fc488 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.636790 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26feda-9954-4c2a-b223-43ca4f0fc488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:39.639406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26feda-9954-4c2a-b223-43ca4f0fc488 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:39.686786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-17b56bc3-139a-48cc-ae41-110ada326e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9489b5299f314fc3a5711391ecc693ba', 'request_id': 'req-17b56bc3-139a-48cc-ae41-110ada326e51'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:39.694962 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-17b56bc3-139a-48cc-ae41-110ada326e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9489b5299f314fc3a5711391ecc693ba', 'request_id': 'req-17b56bc3-139a-48cc-ae41-110ada326e51'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:39.706519 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-17b56bc3-139a-48cc-ae41-110ada326e51 admin admin] The token cache is being invalidate because project 9489b5299f314fc3a5711391ecc693ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:18:39.706914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-17b56bc3-139a-48cc-ae41-110ada326e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:39.707749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-17b56bc3-139a-48cc-ae41-110ada326e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:39.709243 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1137/2276] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:39 2022] DELETE /identity/v3/projects/9489b5299f314fc3a5711391ecc693ba => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:18:39.713984 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60991fb-7bed-42ef-9d1e-b7a9c3d62043 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.714266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60991fb-7bed-42ef-9d1e-b7a9c3d62043 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.714569 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60991fb-7bed-42ef-9d1e-b7a9c3d62043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.734933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b60991fb-7bed-42ef-9d1e-b7a9c3d62043 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:39.736153 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b60991fb-7bed-42ef-9d1e-b7a9c3d62043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:39.745253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1138/2277] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:18:39.753128 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb0c13-6b6f-4ad5-9075-42ffebacac48 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.753458 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb0c13-6b6f-4ad5-9075-42ffebacac48 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.753728 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb0c13-6b6f-4ad5-9075-42ffebacac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.773897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6ddb0c13-6b6f-4ad5-9075-42ffebacac48 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:39.775093 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6ddb0c13-6b6f-4ad5-9075-42ffebacac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:39.778282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:39.783598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1139/2278] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:18:39.785725 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1140/2279] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:39 2022] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:18:39.791763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb0c13-6b6f-4ad5-9075-42ffebacac48 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:39.795108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26feda-9954-4c2a-b223-43ca4f0fc488 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:39.797127 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6a26feda-9954-4c2a-b223-43ca4f0fc488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:39.799447 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb0c13-6b6f-4ad5-9075-42ffebacac48 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:39.804156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32cbf8-6a3b-487a-896c-374c49609822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:39.805060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32cbf8-6a3b-487a-896c-374c49609822 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.805373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32cbf8-6a3b-487a-896c-374c49609822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.805648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32cbf8-6a3b-487a-896c-374c49609822 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.806294 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32cbf8-6a3b-487a-896c-374c49609822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:18:39.806600 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32cbf8-6a3b-487a-896c-374c49609822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:39.808175 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32cbf8-6a3b-487a-896c-374c49609822 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:39.809545 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26feda-9954-4c2a-b223-43ca4f0fc488 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:39.815247 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9552cb-bc43-4242-8e03-9629956ea0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:39.815931 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9552cb-bc43-4242-8e03-9629956ea0fa admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.816210 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9552cb-bc43-4242-8e03-9629956ea0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.816486 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9552cb-bc43-4242-8e03-9629956ea0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.817122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9552cb-bc43-4242-8e03-9629956ea0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:39.818741 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9552cb-bc43-4242-8e03-9629956ea0fa admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:39.821152 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1140/2280] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:18:39.825723 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32cbf8-6a3b-487a-896c-374c49609822 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:39.832715 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1141/2281] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:18:39.833704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9552cb-bc43-4242-8e03-9629956ea0fa admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:39.836003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32cbf8-6a3b-487a-896c-374c49609822 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:39.841016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debdbdd-dc43-4d33-865d-0428c37013f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:39.841821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debdbdd-dc43-4d33-865d-0428c37013f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.842100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debdbdd-dc43-4d33-865d-0428c37013f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.842371 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debdbdd-dc43-4d33-865d-0428c37013f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.843001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debdbdd-dc43-4d33-865d-0428c37013f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:39.843887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9552cb-bc43-4242-8e03-9629956ea0fa admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:39.844917 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debdbdd-dc43-4d33-865d-0428c37013f3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:39.848645 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab789c8-563d-4cb8-ad6d-d2391466712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:39.849224 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab789c8-563d-4cb8-ad6d-d2391466712d admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.849529 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab789c8-563d-4cb8-ad6d-d2391466712d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.849795 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab789c8-563d-4cb8-ad6d-d2391466712d admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.850552 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab789c8-563d-4cb8-ad6d-d2391466712d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:39.852423 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab789c8-563d-4cb8-ad6d-d2391466712d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:39.863485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1142/2282] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:18:39.874396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab789c8-563d-4cb8-ad6d-d2391466712d admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:39.885153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab789c8-563d-4cb8-ad6d-d2391466712d admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:39.889828 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbf464-8de4-4d3f-b1de-1367ca3c0017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:39.890462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbf464-8de4-4d3f-b1de-1367ca3c0017 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:39.890739 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbf464-8de4-4d3f-b1de-1367ca3c0017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:39.891009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbf464-8de4-4d3f-b1de-1367ca3c0017 admin admin] PATH_INFO: `/v3/projects/df0c3699c89445eea542f4840a50f478/users/8886a556822a4f199f57740ed0f6a043/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:39.906363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbf464-8de4-4d3f-b1de-1367ca3c0017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0c3699c89445eea542f4840a50f478, user_id=8886a556822a4f199f57740ed0f6a043, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:39.908999 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbf464-8de4-4d3f-b1de-1367ca3c0017 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:40.003552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1141/2283] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:39 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:18:40.007473 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debdbdd-dc43-4d33-865d-0428c37013f3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:40.023046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1143/2284] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:39 2022] PUT /identity/v3/projects/df0c3699c89445eea542f4840a50f478/users/8886a556822a4f199f57740ed0f6a043/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:18:40.033254 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c6f9f-87ab-453d-9a86-8f049c958186 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.033638 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c6f9f-87ab-453d-9a86-8f049c958186 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.033913 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c6f9f-87ab-453d-9a86-8f049c958186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.054894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:40.063839 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-5b3c6f9f-87ab-453d-9a86-8f049c958186 None None] MFA Rules not processed for user `8886a556822a4f199f57740ed0f6a043`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:40.065080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5b3c6f9f-87ab-453d-9a86-8f049c958186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:40.074032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debdbdd-dc43-4d33-865d-0428c37013f3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:40.130116 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1144/2285] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:18:40.132003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9aaa7e-00f7-44ab-a9e8-5b8ed748c325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:40.132611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aaa7e-00f7-44ab-a9e8-5b8ed748c325 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.132886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aaa7e-00f7-44ab-a9e8-5b8ed748c325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.133154 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aaa7e-00f7-44ab-a9e8-5b8ed748c325 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.133948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9aaa7e-00f7-44ab-a9e8-5b8ed748c325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:40.134521 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c6f9f-87ab-453d-9a86-8f049c958186 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:40.135856 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9aaa7e-00f7-44ab-a9e8-5b8ed748c325 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:40.144818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c6f9f-87ab-453d-9a86-8f049c958186 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:40.149362 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1653b-7450-4709-83f9-e566a8786c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:40.149948 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1653b-7450-4709-83f9-e566a8786c18 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.150229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1653b-7450-4709-83f9-e566a8786c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.150498 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1653b-7450-4709-83f9-e566a8786c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.151121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1653b-7450-4709-83f9-e566a8786c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:40.153004 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1653b-7450-4709-83f9-e566a8786c18 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:40.275092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1142/2286] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:40 2022] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:18:40.279508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9aaa7e-00f7-44ab-a9e8-5b8ed748c325 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:40.289438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9aaa7e-00f7-44ab-a9e8-5b8ed748c325 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:40.297210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89658c76-bda7-40a9-a8f8-1eeda0f1e83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:40.297210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89658c76-bda7-40a9-a8f8-1eeda0f1e83a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.297210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89658c76-bda7-40a9-a8f8-1eeda0f1e83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.297210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89658c76-bda7-40a9-a8f8-1eeda0f1e83a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.297881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89658c76-bda7-40a9-a8f8-1eeda0f1e83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:40.299585 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89658c76-bda7-40a9-a8f8-1eeda0f1e83a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:40.310342 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1143/2287] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:18:40.314380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89658c76-bda7-40a9-a8f8-1eeda0f1e83a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:40.323485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1145/2288] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:40 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:18:40.325598 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89658c76-bda7-40a9-a8f8-1eeda0f1e83a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:40.327526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1653b-7450-4709-83f9-e566a8786c18 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:40.385394 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a013f-af21-4da3-8089-8e6be20dc257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:40.385974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a013f-af21-4da3-8089-8e6be20dc257 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.386232 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a013f-af21-4da3-8089-8e6be20dc257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.386506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a013f-af21-4da3-8089-8e6be20dc257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.387138 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a013f-af21-4da3-8089-8e6be20dc257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:40.388852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a013f-af21-4da3-8089-8e6be20dc257 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:40.392954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1653b-7450-4709-83f9-e566a8786c18 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:40.397711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d9d1d-3696-469c-807a-d68eea013959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:40.398305 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d9d1d-3696-469c-807a-d68eea013959 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.398600 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d9d1d-3696-469c-807a-d68eea013959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.398847 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d9d1d-3696-469c-807a-d68eea013959 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.399224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1144/2289] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:18:40.399481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d9d1d-3696-469c-807a-d68eea013959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:40.401458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d9d1d-3696-469c-807a-d68eea013959 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:40.403389 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a013f-af21-4da3-8089-8e6be20dc257 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:40.417749 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a013f-af21-4da3-8089-8e6be20dc257 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:40.420793 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e194b-9a6a-4aad-8011-2f18f3dd2261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:40.421486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e194b-9a6a-4aad-8011-2f18f3dd2261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.421791 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e194b-9a6a-4aad-8011-2f18f3dd2261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.422061 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e194b-9a6a-4aad-8011-2f18f3dd2261 admin admin] PATH_INFO: `/v3/projects/6fa044b9399044be98de246a679d4ebf/users/7540292ad81549e9bac3551f98d3a53f/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.439573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e194b-9a6a-4aad-8011-2f18f3dd2261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa044b9399044be98de246a679d4ebf, user_id=7540292ad81549e9bac3551f98d3a53f, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:40.443346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e194b-9a6a-4aad-8011-2f18f3dd2261 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:40.509262 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1146/2290] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:40 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:18:40.513223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d9d1d-3696-469c-807a-d68eea013959 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:40.522796 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d9d1d-3696-469c-807a-d68eea013959 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:40.527407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56929be7-f725-409d-8ffd-02dce01ad71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:40.527971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56929be7-f725-409d-8ffd-02dce01ad71b admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.528244 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56929be7-f725-409d-8ffd-02dce01ad71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.528512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56929be7-f725-409d-8ffd-02dce01ad71b admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.529692 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56929be7-f725-409d-8ffd-02dce01ad71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:40.531265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56929be7-f725-409d-8ffd-02dce01ad71b admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:40.533278 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:40.542468 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1147/2291] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:18:40.543773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1145/2292] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:40 2022] PUT /identity/v3/projects/6fa044b9399044be98de246a679d4ebf/users/7540292ad81549e9bac3551f98d3a53f/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:18:40.549079 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56929be7-f725-409d-8ffd-02dce01ad71b admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:40.556508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b7ee-ffe5-4136-8810-7283817a219e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.556790 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b7ee-ffe5-4136-8810-7283817a219e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.557065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256b7ee-ffe5-4136-8810-7283817a219e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.559154 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56929be7-f725-409d-8ffd-02dce01ad71b admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:40.585108 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b256b7ee-ffe5-4136-8810-7283817a219e None None] MFA Rules not processed for user `7540292ad81549e9bac3551f98d3a53f`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:40.586347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b256b7ee-ffe5-4136-8810-7283817a219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:40.617341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:40.618309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1534c-5915-4449-ab5e-98b39b370563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:40.618927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1534c-5915-4449-ab5e-98b39b370563 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.619205 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1534c-5915-4449-ab5e-98b39b370563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.619480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1534c-5915-4449-ab5e-98b39b370563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.620115 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1534c-5915-4449-ab5e-98b39b370563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:40.621859 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1534c-5915-4449-ab5e-98b39b370563 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:40.632411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1148/2293] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:18:40.636215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1534c-5915-4449-ab5e-98b39b370563 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:40.646534 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1534c-5915-4449-ab5e-98b39b370563 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:40.651201 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccc224-edb5-4561-9525-23a77b0e4c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:40.651834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc224-edb5-4561-9525-23a77b0e4c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.652110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc224-edb5-4561-9525-23a77b0e4c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.652380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccc224-edb5-4561-9525-23a77b0e4c35 admin admin] PATH_INFO: `/v3/projects/a1d67c07bde5434da6189d4b04742c9b/users/9597c65b95e14e339f0a0806a50d3327/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.658454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1146/2294] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:18:40.669008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccc224-edb5-4561-9525-23a77b0e4c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d67c07bde5434da6189d4b04742c9b, user_id=9597c65b95e14e339f0a0806a50d3327, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:40.669988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b7ee-ffe5-4136-8810-7283817a219e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:40.671361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b256b7ee-ffe5-4136-8810-7283817a219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:40.671499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccc224-edb5-4561-9525-23a77b0e4c35 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:40.726926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256b7ee-ffe5-4136-8810-7283817a219e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:40.730488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519dc6-750e-4030-b9c6-e046b5d15b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:40.731080 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519dc6-750e-4030-b9c6-e046b5d15b81 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.731352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519dc6-750e-4030-b9c6-e046b5d15b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.731617 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519dc6-750e-4030-b9c6-e046b5d15b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.739564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69519dc6-750e-4030-b9c6-e046b5d15b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:40.740976 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69519dc6-750e-4030-b9c6-e046b5d15b81 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:40.749650 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1147/2295] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:18:40.789861 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1149/2296] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:40 2022] PUT /identity/v3/projects/a1d67c07bde5434da6189d4b04742c9b/users/9597c65b95e14e339f0a0806a50d3327/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:18:40.801993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16cfa8-6c8a-4f5a-a8e9-deb7a13e8a8b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.802277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16cfa8-6c8a-4f5a-a8e9-deb7a13e8a8b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.802551 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16cfa8-6c8a-4f5a-a8e9-deb7a13e8a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.832210 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2d16cfa8-6c8a-4f5a-a8e9-deb7a13e8a8b None None] MFA Rules not processed for user `9597c65b95e14e339f0a0806a50d3327`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:40.833468 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2d16cfa8-6c8a-4f5a-a8e9-deb7a13e8a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:40.922991 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1148/2297] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:40.923183 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccc224-edb5-4561-9525-23a77b0e4c35 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:40.964698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccc224-edb5-4561-9525-23a77b0e4c35 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:40.969396 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091da2cb-f64e-484f-b8ee-2b85f7ebdde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:40.969994 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da2cb-f64e-484f-b8ee-2b85f7ebdde5 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:40.970271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da2cb-f64e-484f-b8ee-2b85f7ebdde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:40.970537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da2cb-f64e-484f-b8ee-2b85f7ebdde5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:40.971152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091da2cb-f64e-484f-b8ee-2b85f7ebdde5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:40.973022 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091da2cb-f64e-484f-b8ee-2b85f7ebdde5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:41.156671 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1150/2298] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:40 2022] POST /identity/v3/projects => generated 387 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:41.160656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16cfa8-6c8a-4f5a-a8e9-deb7a13e8a8b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:41.171010 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16cfa8-6c8a-4f5a-a8e9-deb7a13e8a8b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:41.229542 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8121f99-0c8d-4bbf-b6c8-e0cc734da080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:41.230086 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8121f99-0c8d-4bbf-b6c8-e0cc734da080 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:41.230367 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8121f99-0c8d-4bbf-b6c8-e0cc734da080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:41.230639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8121f99-0c8d-4bbf-b6c8-e0cc734da080 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:41.231284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8121f99-0c8d-4bbf-b6c8-e0cc734da080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:41.233898 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8121f99-0c8d-4bbf-b6c8-e0cc734da080 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:41.243084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:41.343279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1149/2299] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:41 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:41.347370 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091da2cb-f64e-484f-b8ee-2b85f7ebdde5 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:41.358722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091da2cb-f64e-484f-b8ee-2b85f7ebdde5 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:41.363475 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234530f5-f198-4e37-a17e-b84e0705fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:41.364088 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234530f5-f198-4e37-a17e-b84e0705fd16 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:41.364457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234530f5-f198-4e37-a17e-b84e0705fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:41.364738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234530f5-f198-4e37-a17e-b84e0705fd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:41.365439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234530f5-f198-4e37-a17e-b84e0705fd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:41.367016 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234530f5-f198-4e37-a17e-b84e0705fd16 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:41.378943 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1151/2300] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:41.383144 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8121f99-0c8d-4bbf-b6c8-e0cc734da080 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:41.393102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8121f99-0c8d-4bbf-b6c8-e0cc734da080 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:41.397602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3e69d-a798-4866-9be5-a80c726f875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:41.398239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3e69d-a798-4866-9be5-a80c726f875e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:41.398512 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3e69d-a798-4866-9be5-a80c726f875e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:41.398779 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3e69d-a798-4866-9be5-a80c726f875e admin admin] PATH_INFO: `/v3/projects/0fc60dbdd5834291a59a925c44ee8a47/users/92194934ac6c4534b6828e4a3c5d3728/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:41.413237 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3e69d-a798-4866-9be5-a80c726f875e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc60dbdd5834291a59a925c44ee8a47, user_id=92194934ac6c4534b6828e4a3c5d3728, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:41.415868 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3e69d-a798-4866-9be5-a80c726f875e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:41.486494 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1150/2301] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:41 2022] PUT /identity/v3/projects/0fc60dbdd5834291a59a925c44ee8a47/users/92194934ac6c4534b6828e4a3c5d3728/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:41.490408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234530f5-f198-4e37-a17e-b84e0705fd16 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:41.501424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234530f5-f198-4e37-a17e-b84e0705fd16 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:41.546462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:41.561298 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3d0f6-35c1-4840-884f-0808ef874be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:41.561912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d0f6-35c1-4840-884f-0808ef874be6 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:41.562183 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d0f6-35c1-4840-884f-0808ef874be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:41.562448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d0f6-35c1-4840-884f-0808ef874be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:41.563083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3d0f6-35c1-4840-884f-0808ef874be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:41.564771 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3d0f6-35c1-4840-884f-0808ef874be6 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:41.577321 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1152/2302] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:41.580753 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3e69d-a798-4866-9be5-a80c726f875e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:41.591070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3e69d-a798-4866-9be5-a80c726f875e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:41.596016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b7ab8-d65f-4270-9205-d0a958c841bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:41.596650 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b7ab8-d65f-4270-9205-d0a958c841bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:41.596923 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b7ab8-d65f-4270-9205-d0a958c841bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:41.597191 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b7ab8-d65f-4270-9205-d0a958c841bc admin admin] PATH_INFO: `/v3/projects/0fc60dbdd5834291a59a925c44ee8a47/users/92194934ac6c4534b6828e4a3c5d3728/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:41.599163 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b7ab8-d65f-4270-9205-d0a958c841bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc60dbdd5834291a59a925c44ee8a47, user_id=92194934ac6c4534b6828e4a3c5d3728, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:41.601870 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b7ab8-d65f-4270-9205-d0a958c841bc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:41.613112 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1151/2303] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:41 2022] PUT /identity/v3/projects/0fc60dbdd5834291a59a925c44ee8a47/users/92194934ac6c4534b6828e4a3c5d3728/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:41.623955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1506da-4824-4871-ab36-0173fd762520 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:41.624244 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1506da-4824-4871-ab36-0173fd762520 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:41.624508 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1506da-4824-4871-ab36-0173fd762520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:41.652798 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-fe1506da-4824-4871-ab36-0173fd762520 None None] MFA Rules not processed for user `92194934ac6c4534b6828e4a3c5d3728`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:41.654479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-fe1506da-4824-4871-ab36-0173fd762520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:41.722831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1153/2304] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:41.734891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b7ab8-d65f-4270-9205-d0a958c841bc admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:41.789775 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b7ab8-d65f-4270-9205-d0a958c841bc admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:41.793395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf55a63-2e9d-4208-bb65-293bea4f9fdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:41.793988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf55a63-2e9d-4208-bb65-293bea4f9fdd service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:41.794259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf55a63-2e9d-4208-bb65-293bea4f9fdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:41.795150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf55a63-2e9d-4208-bb65-293bea4f9fdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:41.804073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf55a63-2e9d-4208-bb65-293bea4f9fdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:41.805824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf55a63-2e9d-4208-bb65-293bea4f9fdd service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:41.815244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1152/2305] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:43.042870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1506da-4824-4871-ab36-0173fd762520 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:43.044274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-fe1506da-4824-4871-ab36-0173fd762520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:43.057036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1506da-4824-4871-ab36-0173fd762520 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:43.061431 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3709db-21e0-4a0f-9e64-44269da7606a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:43.062009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3709db-21e0-4a0f-9e64-44269da7606a service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:43.062277 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3709db-21e0-4a0f-9e64-44269da7606a service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:43.062540 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3709db-21e0-4a0f-9e64-44269da7606a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:43.120880 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3709db-21e0-4a0f-9e64-44269da7606a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:43.123193 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3709db-21e0-4a0f-9e64-44269da7606a service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:43.132408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1154/2306] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:48.319639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf55a63-2e9d-4208-bb65-293bea4f9fdd service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:48.329060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf55a63-2e9d-4208-bb65-293bea4f9fdd service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:48.332656 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cbbaf-2261-4276-aba9-7c0e181ab601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:48.333249 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cbbaf-2261-4276-aba9-7c0e181ab601 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:48.333565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cbbaf-2261-4276-aba9-7c0e181ab601 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:48.333836 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cbbaf-2261-4276-aba9-7c0e181ab601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:48.390108 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cbbaf-2261-4276-aba9-7c0e181ab601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:48.391603 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cbbaf-2261-4276-aba9-7c0e181ab601 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:48.400508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1153/2307] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:52.959152 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3709db-21e0-4a0f-9e64-44269da7606a service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:53.021932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3709db-21e0-4a0f-9e64-44269da7606a service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:53.026341 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:53.026982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:53.027275 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:53.027525 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] PATH_INFO: `/v3/users/8886a556822a4f199f57740ed0f6a043` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:53.028667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8886a556822a4f199f57740ed0f6a043)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:53.030624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:53.035825 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=100 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:53.231081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8886a556822a4f199f57740ed0f6a043'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:53.231722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8886a556822a4f199f57740ed0f6a043'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:53.245060 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8886a556822a4f199f57740ed0f6a043'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:53.249419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8886a556822a4f199f57740ed0f6a043'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:53.332091 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8886a556822a4f199f57740ed0f6a043'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:53.346087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1155/2308] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:18:52 2022] DELETE /identity/v3/users/8886a556822a4f199f57740ed0f6a043 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:53.350676 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1ff4-9b93-419c-afdd-567ec0b22d3e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:53.351157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1ff4-9b93-419c-afdd-567ec0b22d3e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:53.351260 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1ff4-9b93-419c-afdd-567ec0b22d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:53.370462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cc5e1ff4-9b93-419c-afdd-567ec0b22d3e None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:53.371657 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cc5e1ff4-9b93-419c-afdd-567ec0b22d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:53.420304 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:53.431686 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1154/2309] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:53.441903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:53.443330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:53.503613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044892e-9e5f-4eca-a36b-49c689971bc5 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:53.506444 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b7965-f105-44a1-a5b1-5a6befda1a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:53.507136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7965-f105-44a1-a5b1-5a6befda1a44 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:53.507415 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7965-f105-44a1-a5b1-5a6befda1a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:53.507684 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7965-f105-44a1-a5b1-5a6befda1a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:53.518530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b7965-f105-44a1-a5b1-5a6befda1a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:53.519953 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b7965-f105-44a1-a5b1-5a6befda1a44 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:53.529765 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1156/2310] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:53.949126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e1ff4-9b93-419c-afdd-567ec0b22d3e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:53.950581 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cc5e1ff4-9b93-419c-afdd-567ec0b22d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:53.962813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e1ff4-9b93-419c-afdd-567ec0b22d3e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:53.967608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:53.968199 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:53.973238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:53.973238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] PATH_INFO: `/v3/projects/df0c3699c89445eea542f4840a50f478` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:53.974032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0c3699c89445eea542f4840a50f478)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:53.975994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:54.122859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0c3699c89445eea542f4840a50f478', 'request_id': 'req-28016f46-2c69-4d50-b7ac-4128324c1c5a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:54.221732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0c3699c89445eea542f4840a50f478', 'request_id': 'req-28016f46-2c69-4d50-b7ac-4128324c1c5a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:54.228582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0c3699c89445eea542f4840a50f478', 'request_id': 'req-28016f46-2c69-4d50-b7ac-4128324c1c5a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:54.241603 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] The token cache is being invalidate because project df0c3699c89445eea542f4840a50f478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:18:54.241893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:54.242667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:54.244326 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1155/2311] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:53 2022] DELETE /identity/v3/projects/df0c3699c89445eea542f4840a50f478 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:54.248440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b7965-f105-44a1-a5b1-5a6befda1a44 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:54.259519 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b7965-f105-44a1-a5b1-5a6befda1a44 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:54.319531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:54.320136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:54.320450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:54.320718 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] PATH_INFO: `/v3/users/9597c65b95e14e339f0a0806a50d3327` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:54.321852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9597c65b95e14e339f0a0806a50d3327)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:54.323751 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:54.424376 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:54.511797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9597c65b95e14e339f0a0806a50d3327'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:54.512452 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9597c65b95e14e339f0a0806a50d3327'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:54.525269 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9597c65b95e14e339f0a0806a50d3327'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:54.526772 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9597c65b95e14e339f0a0806a50d3327'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:54.595655 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9597c65b95e14e339f0a0806a50d3327'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:54.608921 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1157/2312] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:18:54 2022] DELETE /identity/v3/users/9597c65b95e14e339f0a0806a50d3327 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:55.111706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:55.114511 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:55.138788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016f46-2c69-4d50-b7ac-4128324c1c5a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:55.240630 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:55.241331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:55.241704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:55.242336 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] PATH_INFO: `/v3/projects/a1d67c07bde5434da6189d4b04742c9b` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:55.244550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d67c07bde5434da6189d4b04742c9b)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:55.247066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:55.423560 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d67c07bde5434da6189d4b04742c9b', 'request_id': 'req-05837216-0e71-4e5e-999f-27b1194f25e1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:55.543620 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d67c07bde5434da6189d4b04742c9b', 'request_id': 'req-05837216-0e71-4e5e-999f-27b1194f25e1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:55.551351 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d67c07bde5434da6189d4b04742c9b', 'request_id': 'req-05837216-0e71-4e5e-999f-27b1194f25e1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:55.563584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] The token cache is being invalidate because project a1d67c07bde5434da6189d4b04742c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:18:55.563876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:55.564612 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:55.566209 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1156/2313] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:55 2022] DELETE /identity/v3/projects/a1d67c07bde5434da6189d4b04742c9b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:55.570313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:55.571773 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:55.584781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca6660-0bb6-4220-b101-1c55604d94bc admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:55.645055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c043e6-8b05-43fc-8844-dc9f82e0a085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:55.645748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c043e6-8b05-43fc-8844-dc9f82e0a085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:55.646021 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c043e6-8b05-43fc-8844-dc9f82e0a085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:55.646284 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c043e6-8b05-43fc-8844-dc9f82e0a085 admin admin] PATH_INFO: `/v3/users/92194934ac6c4534b6828e4a3c5d3728` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:55.647424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c043e6-8b05-43fc-8844-dc9f82e0a085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92194934ac6c4534b6828e4a3c5d3728)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:55.649393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c043e6-8b05-43fc-8844-dc9f82e0a085 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:55.858821 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a8c043e6-8b05-43fc-8844-dc9f82e0a085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92194934ac6c4534b6828e4a3c5d3728'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:55.861457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a8c043e6-8b05-43fc-8844-dc9f82e0a085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92194934ac6c4534b6828e4a3c5d3728'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:55.874194 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a8c043e6-8b05-43fc-8844-dc9f82e0a085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92194934ac6c4534b6828e4a3c5d3728'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:55.875629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a8c043e6-8b05-43fc-8844-dc9f82e0a085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92194934ac6c4534b6828e4a3c5d3728'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:55.995376 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a8c043e6-8b05-43fc-8844-dc9f82e0a085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92194934ac6c4534b6828e4a3c5d3728'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:56.014334 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1158/2314] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:18:55 2022] DELETE /identity/v3/users/92194934ac6c4534b6828e4a3c5d3728 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:56.522863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:56.524333 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:56.538914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05837216-0e71-4e5e-999f-27b1194f25e1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:56.545640 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:56.600253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985cc7b-9785-4ac4-b37e-1d44766bc51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:56.600897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985cc7b-9785-4ac4-b37e-1d44766bc51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:56.601205 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985cc7b-9785-4ac4-b37e-1d44766bc51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:56.607202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985cc7b-9785-4ac4-b37e-1d44766bc51d admin admin] PATH_INFO: `/v3/projects/0fc60dbdd5834291a59a925c44ee8a47` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:56.607202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985cc7b-9785-4ac4-b37e-1d44766bc51d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc60dbdd5834291a59a925c44ee8a47)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:56.607202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985cc7b-9785-4ac4-b37e-1d44766bc51d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:56.727224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2985cc7b-9785-4ac4-b37e-1d44766bc51d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc60dbdd5834291a59a925c44ee8a47', 'request_id': 'req-2985cc7b-9785-4ac4-b37e-1d44766bc51d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:56.884681 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2985cc7b-9785-4ac4-b37e-1d44766bc51d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc60dbdd5834291a59a925c44ee8a47', 'request_id': 'req-2985cc7b-9785-4ac4-b37e-1d44766bc51d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:56.892377 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2985cc7b-9785-4ac4-b37e-1d44766bc51d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc60dbdd5834291a59a925c44ee8a47', 'request_id': 'req-2985cc7b-9785-4ac4-b37e-1d44766bc51d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:56.902904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2985cc7b-9785-4ac4-b37e-1d44766bc51d admin admin] The token cache is being invalidate because project 0fc60dbdd5834291a59a925c44ee8a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:18:56.903186 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2985cc7b-9785-4ac4-b37e-1d44766bc51d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:56.903824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2985cc7b-9785-4ac4-b37e-1d44766bc51d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:18:56.905314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1157/2315] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:56 2022] DELETE /identity/v3/projects/0fc60dbdd5834291a59a925c44ee8a47 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:18:56.911460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec99cd8-2535-47c5-bdf0-2fcadcae0d8a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:56.911940 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec99cd8-2535-47c5-bdf0-2fcadcae0d8a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:56.912037 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec99cd8-2535-47c5-bdf0-2fcadcae0d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:56.931511 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-3ec99cd8-2535-47c5-bdf0-2fcadcae0d8a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:56.932683 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3ec99cd8-2535-47c5-bdf0-2fcadcae0d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:56.951595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:56.994714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1159/2316] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:57.005103 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbac5e-6f2d-4263-9263-9032371d7813 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:57.005425 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbac5e-6f2d-4263-9263-9032371d7813 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:57.005702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbac5e-6f2d-4263-9263-9032371d7813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:57.025581 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7acbac5e-6f2d-4263-9263-9032371d7813 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:57.026772 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7acbac5e-6f2d-4263-9263-9032371d7813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:57.034845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1158/2317] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:57.039130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec99cd8-2535-47c5-bdf0-2fcadcae0d8a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:57.049192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec99cd8-2535-47c5-bdf0-2fcadcae0d8a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:57.054108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bbc3c-e9a3-431b-a2ad-bf13f5a55794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:57.055052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bbc3c-e9a3-431b-a2ad-bf13f5a55794 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:57.055319 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bbc3c-e9a3-431b-a2ad-bf13f5a55794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:57.055591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bbc3c-e9a3-431b-a2ad-bf13f5a55794 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:57.056301 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bbc3c-e9a3-431b-a2ad-bf13f5a55794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:18:57.056531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bbc3c-e9a3-431b-a2ad-bf13f5a55794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:57.058147 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bbc3c-e9a3-431b-a2ad-bf13f5a55794 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:57.073708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1160/2318] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:18:57.074838 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbac5e-6f2d-4263-9263-9032371d7813 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:57.084009 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbac5e-6f2d-4263-9263-9032371d7813 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:57.089165 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77e5d9-a09c-4162-ae62-d46994a4f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:57.094524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e5d9-a09c-4162-ae62-d46994a4f46b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:57.094524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e5d9-a09c-4162-ae62-d46994a4f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:57.094524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77e5d9-a09c-4162-ae62-d46994a4f46b admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:57.094524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77e5d9-a09c-4162-ae62-d46994a4f46b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:57.094524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77e5d9-a09c-4162-ae62-d46994a4f46b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:57.178247 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1159/2319] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:57 2022] POST /identity/v3/projects => generated 401 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:18:57.182654 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bbc3c-e9a3-431b-a2ad-bf13f5a55794 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:57.193657 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bbc3c-e9a3-431b-a2ad-bf13f5a55794 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:57.255938 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9acde2-8b22-4c3d-bbd7-c92759d0e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:57.256573 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9acde2-8b22-4c3d-bbd7-c92759d0e664 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:57.256845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9acde2-8b22-4c3d-bbd7-c92759d0e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:57.257130 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9acde2-8b22-4c3d-bbd7-c92759d0e664 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:57.257986 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9acde2-8b22-4c3d-bbd7-c92759d0e664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:57.260470 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9acde2-8b22-4c3d-bbd7-c92759d0e664 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:57.380027 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1161/2320] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:57 2022] POST /identity/v3/users => generated 301 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:18:57.382994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77e5d9-a09c-4162-ae62-d46994a4f46b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:57.393719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77e5d9-a09c-4162-ae62-d46994a4f46b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:57.398195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79c7a9-62c8-469c-bec7-c83386d86dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:57.398795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c7a9-62c8-469c-bec7-c83386d86dbd admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:57.399059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c7a9-62c8-469c-bec7-c83386d86dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:57.399322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c7a9-62c8-469c-bec7-c83386d86dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:57.399980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79c7a9-62c8-469c-bec7-c83386d86dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:57.401582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79c7a9-62c8-469c-bec7-c83386d86dbd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:57.412072 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1160/2321] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:57.417198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9acde2-8b22-4c3d-bbd7-c92759d0e664 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:57.428105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9acde2-8b22-4c3d-bbd7-c92759d0e664 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:57.433514 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf2481-452a-41be-ad4c-6faf06986cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:57.434173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf2481-452a-41be-ad4c-6faf06986cfa admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:57.434453 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf2481-452a-41be-ad4c-6faf06986cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:57.434751 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf2481-452a-41be-ad4c-6faf06986cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:57.435422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf2481-452a-41be-ad4c-6faf06986cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:57.437776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf2481-452a-41be-ad4c-6faf06986cfa admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:57.449404 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1162/2322] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:57.454460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79c7a9-62c8-469c-bec7-c83386d86dbd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:57.464549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79c7a9-62c8-469c-bec7-c83386d86dbd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:57.469205 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8e0c9-2056-4194-a102-adb26fc93644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:57.469887 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8e0c9-2056-4194-a102-adb26fc93644 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:57.470167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8e0c9-2056-4194-a102-adb26fc93644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:57.470438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8e0c9-2056-4194-a102-adb26fc93644 admin admin] PATH_INFO: `/v3/projects/e7f75ae349d34506bf28a7baaaa522f3/users/4e68ef5f16574649a71f4a5d41f55d7f/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:57.485311 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8e0c9-2056-4194-a102-adb26fc93644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7f75ae349d34506bf28a7baaaa522f3, user_id=4e68ef5f16574649a71f4a5d41f55d7f, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:57.489065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8e0c9-2056-4194-a102-adb26fc93644 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:57.595121 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1161/2323] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:57 2022] PUT /identity/v3/projects/e7f75ae349d34506bf28a7baaaa522f3/users/4e68ef5f16574649a71f4a5d41f55d7f/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:18:57.607093 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12fcb4-ad85-497b-b925-65277489070f None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:57.607376 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12fcb4-ad85-497b-b925-65277489070f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:57.607648 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12fcb4-ad85-497b-b925-65277489070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:57.636632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-ff12fcb4-ad85-497b-b925-65277489070f None None] MFA Rules not processed for user `4e68ef5f16574649a71f4a5d41f55d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:57.637888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ff12fcb4-ad85-497b-b925-65277489070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:57.716448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1163/2324] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:57 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:57.720284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8e0c9-2056-4194-a102-adb26fc93644 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:57.786970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:57.809737 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8e0c9-2056-4194-a102-adb26fc93644 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:57.815037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907a7c1-4a58-469c-9307-8911e72d2aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:57.815689 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907a7c1-4a58-469c-9307-8911e72d2aea admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:57.815973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907a7c1-4a58-469c-9307-8911e72d2aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:57.816239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907a7c1-4a58-469c-9307-8911e72d2aea admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:57.816871 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907a7c1-4a58-469c-9307-8911e72d2aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:57.818836 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907a7c1-4a58-469c-9307-8911e72d2aea admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:57.938634 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1162/2325] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:18:57 2022] POST /identity/v3/projects => generated 401 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:57.943897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12fcb4-ad85-497b-b925-65277489070f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:57.954954 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12fcb4-ad85-497b-b925-65277489070f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:57.984732 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:58.029195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44632a-2afd-463d-b312-93ab3d4e5bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:58.029956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44632a-2afd-463d-b312-93ab3d4e5bab admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:58.030399 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44632a-2afd-463d-b312-93ab3d4e5bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:58.030864 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44632a-2afd-463d-b312-93ab3d4e5bab admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:58.031775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44632a-2afd-463d-b312-93ab3d4e5bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:58.037206 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44632a-2afd-463d-b312-93ab3d4e5bab admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:58.116001 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1164/2326] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:18:57 2022] POST /identity/v3/users => generated 307 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:18:58.120156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907a7c1-4a58-469c-9307-8911e72d2aea admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:58.131175 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907a7c1-4a58-469c-9307-8911e72d2aea admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:58.135721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88c840-026e-4825-97fe-63ef519d91f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:58.141176 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c840-026e-4825-97fe-63ef519d91f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:58.141176 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c840-026e-4825-97fe-63ef519d91f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:58.141176 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c840-026e-4825-97fe-63ef519d91f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:58.141176 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88c840-026e-4825-97fe-63ef519d91f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:58.141176 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88c840-026e-4825-97fe-63ef519d91f3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:58.149372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1163/2327] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:18:58.153450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44632a-2afd-463d-b312-93ab3d4e5bab admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:58.164173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44632a-2afd-463d-b312-93ab3d4e5bab admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:58.168863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c70a78-23b7-460a-98c3-be6e3ffe84c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:58.169534 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c70a78-23b7-460a-98c3-be6e3ffe84c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:58.169843 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c70a78-23b7-460a-98c3-be6e3ffe84c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:58.170115 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c70a78-23b7-460a-98c3-be6e3ffe84c5 admin admin] PATH_INFO: `/v3/projects/52ab389850564fed98d9974a73934699/users/f8305bc10bf14039847e98cbec0e3e8c/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:58.185968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c70a78-23b7-460a-98c3-be6e3ffe84c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ab389850564fed98d9974a73934699, user_id=f8305bc10bf14039847e98cbec0e3e8c, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:58.189003 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c70a78-23b7-460a-98c3-be6e3ffe84c5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:58.273312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1165/2328] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:58 2022] PUT /identity/v3/projects/52ab389850564fed98d9974a73934699/users/f8305bc10bf14039847e98cbec0e3e8c/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:18:58.274211 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88c840-026e-4825-97fe-63ef519d91f3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:58.286732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88c840-026e-4825-97fe-63ef519d91f3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:58.354525 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476f833-c821-461b-972a-f4419bf11854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:58.355126 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476f833-c821-461b-972a-f4419bf11854 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:58.355399 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476f833-c821-461b-972a-f4419bf11854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:58.355665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476f833-c821-461b-972a-f4419bf11854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:58.356299 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476f833-c821-461b-972a-f4419bf11854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:58.357934 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476f833-c821-461b-972a-f4419bf11854 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:58.368408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1164/2329] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:18:58.372587 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c70a78-23b7-460a-98c3-be6e3ffe84c5 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:58.383154 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c70a78-23b7-460a-98c3-be6e3ffe84c5 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:58.387793 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3058a8-0dd4-4088-b292-edfe9d15cc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:58.388450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3058a8-0dd4-4088-b292-edfe9d15cc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:58.388703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3058a8-0dd4-4088-b292-edfe9d15cc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:58.388973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3058a8-0dd4-4088-b292-edfe9d15cc3a admin admin] PATH_INFO: `/v3/projects/52ab389850564fed98d9974a73934699/users/f8305bc10bf14039847e98cbec0e3e8c/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:58.391286 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3058a8-0dd4-4088-b292-edfe9d15cc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ab389850564fed98d9974a73934699, user_id=f8305bc10bf14039847e98cbec0e3e8c, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:58.399572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3058a8-0dd4-4088-b292-edfe9d15cc3a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:58.405371 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1166/2330] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:18:58 2022] PUT /identity/v3/projects/52ab389850564fed98d9974a73934699/users/f8305bc10bf14039847e98cbec0e3e8c/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:18:58.416338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f8142-9c13-4e26-9b91-6e7894e3f972 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:58.416620 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f8142-9c13-4e26-9b91-6e7894e3f972 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:58.416911 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f8142-9c13-4e26-9b91-6e7894e3f972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:58.445623 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-008f8142-9c13-4e26-9b91-6e7894e3f972 None None] MFA Rules not processed for user `f8305bc10bf14039847e98cbec0e3e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:18:58.446759 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-008f8142-9c13-4e26-9b91-6e7894e3f972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:58.519882 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1165/2331] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:18:58 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:18:58.531635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3058a8-0dd4-4088-b292-edfe9d15cc3a admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:58.534204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2e3058a8-0dd4-4088-b292-edfe9d15cc3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:18:58.602485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3058a8-0dd4-4088-b292-edfe9d15cc3a admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:58.606185 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322500a-dc8e-4371-9c85-80d84b4d1b0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:58.606788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322500a-dc8e-4371-9c85-80d84b4d1b0e service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:58.607065 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322500a-dc8e-4371-9c85-80d84b4d1b0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:58.607336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322500a-dc8e-4371-9c85-80d84b4d1b0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:58.617475 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322500a-dc8e-4371-9c85-80d84b4d1b0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:58.619036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322500a-dc8e-4371-9c85-80d84b4d1b0e service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:58.631122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1167/2332] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:58 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:18:58.880128 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f8142-9c13-4e26-9b91-6e7894e3f972 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:18:58.889906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f8142-9c13-4e26-9b91-6e7894e3f972 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:18:58.894048 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a29fe1-ed76-4cda-a8a8-b5144818105e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:18:58.894643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a29fe1-ed76-4cda-a8a8-b5144818105e service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:18:58.894914 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a29fe1-ed76-4cda-a8a8-b5144818105e service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:18:58.895180 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a29fe1-ed76-4cda-a8a8-b5144818105e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:18:58.929529 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:58.958518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a29fe1-ed76-4cda-a8a8-b5144818105e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:18:58.960021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a29fe1-ed76-4cda-a8a8-b5144818105e service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:18:58.970137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1166/2333] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:18:58 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:01.112067 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322500a-dc8e-4371-9c85-80d84b4d1b0e service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:01.113513 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7322500a-dc8e-4371-9c85-80d84b4d1b0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:01.178499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322500a-dc8e-4371-9c85-80d84b4d1b0e service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:01.182315 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5726d-12ba-4390-89c3-516d29bc4867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:01.182913 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5726d-12ba-4390-89c3-516d29bc4867 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:01.183189 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5726d-12ba-4390-89c3-516d29bc4867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:01.183462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5726d-12ba-4390-89c3-516d29bc4867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:01.185149 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3dc5726d-12ba-4390-89c3-516d29bc4867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:01.216350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:01.251143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5726d-12ba-4390-89c3-516d29bc4867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:01.252590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5726d-12ba-4390-89c3-516d29bc4867 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:01.262603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1168/2334] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:04.471356 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a29fe1-ed76-4cda-a8a8-b5144818105e service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:04.483398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a29fe1-ed76-4cda-a8a8-b5144818105e service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:04.488700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:04.489488 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:04.489860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:04.490227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] PATH_INFO: `/v3/users/4e68ef5f16574649a71f4a5d41f55d7f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:04.491502 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e68ef5f16574649a71f4a5d41f55d7f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:04.493563 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:04.724471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e68ef5f16574649a71f4a5d41f55d7f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:04.725175 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e68ef5f16574649a71f4a5d41f55d7f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:04.732533 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e68ef5f16574649a71f4a5d41f55d7f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:04.850254 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e68ef5f16574649a71f4a5d41f55d7f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:04.867455 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e68ef5f16574649a71f4a5d41f55d7f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:04.877777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1167/2335] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:04 2022] DELETE /identity/v3/users/4e68ef5f16574649a71f4a5d41f55d7f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:04.882108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c9b5-0e77-42a7-aab0-50a257574b87 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:04.882580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c9b5-0e77-42a7-aab0-50a257574b87 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:04.882767 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719c9b5-0e77-42a7-aab0-50a257574b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:04.905737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-8719c9b5-0e77-42a7-aab0-50a257574b87 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:04.907137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-8719c9b5-0e77-42a7-aab0-50a257574b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:04.986477 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1169/2336] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:04.993981 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:04.995451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:05.059437 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a7ea6-2015-4c3b-9fe7-011e5348410f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:05.063048 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1d3a2-9af0-4df9-8bd4-175503441dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:05.063650 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1d3a2-9af0-4df9-8bd4-175503441dce service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:05.063927 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1d3a2-9af0-4df9-8bd4-175503441dce service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:05.064198 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1d3a2-9af0-4df9-8bd4-175503441dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:05.073503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1d3a2-9af0-4df9-8bd4-175503441dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:05.074920 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1d3a2-9af0-4df9-8bd4-175503441dce service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:05.084674 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1168/2337] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:05.093603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c9b5-0e77-42a7-aab0-50a257574b87 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:05.095077 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-8719c9b5-0e77-42a7-aab0-50a257574b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:05.110055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719c9b5-0e77-42a7-aab0-50a257574b87 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:05.116867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:05.117676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:05.117952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:05.118224 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] PATH_INFO: `/v3/users/5d83b424ffbc4a879b490d9ac6e84ef5` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:05.119820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d83b424ffbc4a879b490d9ac6e84ef5)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:05.121983 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:05.347890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d83b424ffbc4a879b490d9ac6e84ef5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:05.348543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d83b424ffbc4a879b490d9ac6e84ef5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:05.361387 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d83b424ffbc4a879b490d9ac6e84ef5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:05.363952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d83b424ffbc4a879b490d9ac6e84ef5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:05.475553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d83b424ffbc4a879b490d9ac6e84ef5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:05.489274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1170/2338] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:05 2022] DELETE /identity/v3/users/5d83b424ffbc4a879b490d9ac6e84ef5 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:05.540718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1d3a2-9af0-4df9-8bd4-175503441dce service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:05.542590 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-45a1d3a2-9af0-4df9-8bd4-175503441dce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:05.564443 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1d3a2-9af0-4df9-8bd4-175503441dce service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:05.609720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:05.627306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:05.627860 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:05.628190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:05.628467 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] PATH_INFO: `/v3/projects/e7f75ae349d34506bf28a7baaaa522f3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:05.629621 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7f75ae349d34506bf28a7baaaa522f3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:05.631508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:05.772707 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:05.774342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:05.775759 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7f75ae349d34506bf28a7baaaa522f3', 'request_id': 'req-16182efd-a8cc-4549-b413-c3fca0a7fcb4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:05.790191 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c6c72-6228-4b4b-ac71-450651408ce0 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:05.829115 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:05.853578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743d5e-fce0-4630-8d94-baceff2cdc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:05.854373 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743d5e-fce0-4630-8d94-baceff2cdc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:05.854544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743d5e-fce0-4630-8d94-baceff2cdc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:05.854815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743d5e-fce0-4630-8d94-baceff2cdc1f admin admin] PATH_INFO: `/v3/projects/3620948adaa843ae995e58313d8d9b1c` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:05.855946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8743d5e-fce0-4630-8d94-baceff2cdc1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3620948adaa843ae995e58313d8d9b1c)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:05.857950 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8743d5e-fce0-4630-8d94-baceff2cdc1f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:05.879825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7f75ae349d34506bf28a7baaaa522f3', 'request_id': 'req-16182efd-a8cc-4549-b413-c3fca0a7fcb4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:05.886629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7f75ae349d34506bf28a7baaaa522f3', 'request_id': 'req-16182efd-a8cc-4549-b413-c3fca0a7fcb4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:05.897601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] The token cache is being invalidate because project e7f75ae349d34506bf28a7baaaa522f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:05.897892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:05.898536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:05.900063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1169/2339] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:05 2022] DELETE /identity/v3/projects/e7f75ae349d34506bf28a7baaaa522f3 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:05.910316 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:05.911809 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:05.925966 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182efd-a8cc-4549-b413-c3fca0a7fcb4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:05.930941 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672e870-efb1-4523-a259-7c2d46f793bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:05.931570 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672e870-efb1-4523-a259-7c2d46f793bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:05.931851 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672e870-efb1-4523-a259-7c2d46f793bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:05.933752 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672e870-efb1-4523-a259-7c2d46f793bf admin admin] PATH_INFO: `/v3/users/f8305bc10bf14039847e98cbec0e3e8c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:05.933752 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672e870-efb1-4523-a259-7c2d46f793bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8305bc10bf14039847e98cbec0e3e8c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:05.935154 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672e870-efb1-4523-a259-7c2d46f793bf admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:05.982277 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f8743d5e-fce0-4630-8d94-baceff2cdc1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3620948adaa843ae995e58313d8d9b1c', 'request_id': 'req-f8743d5e-fce0-4630-8d94-baceff2cdc1f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.051870 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f8743d5e-fce0-4630-8d94-baceff2cdc1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3620948adaa843ae995e58313d8d9b1c', 'request_id': 'req-f8743d5e-fce0-4630-8d94-baceff2cdc1f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.059938 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f8743d5e-fce0-4630-8d94-baceff2cdc1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3620948adaa843ae995e58313d8d9b1c', 'request_id': 'req-f8743d5e-fce0-4630-8d94-baceff2cdc1f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.071198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f8743d5e-fce0-4630-8d94-baceff2cdc1f admin admin] The token cache is being invalidate because project 3620948adaa843ae995e58313d8d9b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:06.071485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f8743d5e-fce0-4630-8d94-baceff2cdc1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.072141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-f8743d5e-fce0-4630-8d94-baceff2cdc1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.073738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1171/2340] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:05 2022] DELETE /identity/v3/projects/3620948adaa843ae995e58313d8d9b1c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:06.078382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f486d0c-3494-4107-8bcc-c773586db986 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:06.078667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f486d0c-3494-4107-8bcc-c773586db986 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:06.078940 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f486d0c-3494-4107-8bcc-c773586db986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:06.099516 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0f486d0c-3494-4107-8bcc-c773586db986 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:06.100820 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0f486d0c-3494-4107-8bcc-c773586db986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:06.133675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a672e870-efb1-4523-a259-7c2d46f793bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8305bc10bf14039847e98cbec0e3e8c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.134368 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a672e870-efb1-4523-a259-7c2d46f793bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8305bc10bf14039847e98cbec0e3e8c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.142375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a672e870-efb1-4523-a259-7c2d46f793bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8305bc10bf14039847e98cbec0e3e8c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.161324 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1172/2341] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:06.169037 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c37b32-4fa5-4a9a-a4bc-b49c1111d4c3 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:06.169349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c37b32-4fa5-4a9a-a4bc-b49c1111d4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:06.169624 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c37b32-4fa5-4a9a-a4bc-b49c1111d4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:06.191259 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-a5c37b32-4fa5-4a9a-a4bc-b49c1111d4c3 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:06.192557 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a5c37b32-4fa5-4a9a-a4bc-b49c1111d4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:06.200765 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1173/2342] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:06.204818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c37b32-4fa5-4a9a-a4bc-b49c1111d4c3 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:06.212440 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a672e870-efb1-4523-a259-7c2d46f793bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8305bc10bf14039847e98cbec0e3e8c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.215087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c37b32-4fa5-4a9a-a4bc-b49c1111d4c3 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:06.219789 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc037037-7c6c-4e51-bf28-584c3fb15b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:06.220380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc037037-7c6c-4e51-bf28-584c3fb15b02 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:06.220656 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc037037-7c6c-4e51-bf28-584c3fb15b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:06.220920 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc037037-7c6c-4e51-bf28-584c3fb15b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:06.222273 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc037037-7c6c-4e51-bf28-584c3fb15b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:19:06.222570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc037037-7c6c-4e51-bf28-584c3fb15b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:06.224190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc037037-7c6c-4e51-bf28-584c3fb15b02 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:06.231955 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a672e870-efb1-4523-a259-7c2d46f793bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8305bc10bf14039847e98cbec0e3e8c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.238391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1174/2343] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:19:06.241673 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1170/2344] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:05 2022] DELETE /identity/v3/users/f8305bc10bf14039847e98cbec0e3e8c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:06.242848 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc037037-7c6c-4e51-bf28-584c3fb15b02 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:06.252825 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc037037-7c6c-4e51-bf28-584c3fb15b02 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:06.321276 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c850a3-0bdf-4bd7-aa00-2a8b263b1d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:06.321955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c850a3-0bdf-4bd7-aa00-2a8b263b1d24 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:06.322237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c850a3-0bdf-4bd7-aa00-2a8b263b1d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:06.322510 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c850a3-0bdf-4bd7-aa00-2a8b263b1d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:06.323161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c850a3-0bdf-4bd7-aa00-2a8b263b1d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:06.325153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c850a3-0bdf-4bd7-aa00-2a8b263b1d24 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:06.453733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:06.464493 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1175/2345] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:06 2022] POST /identity/v3/projects => generated 403 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:06.465624 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672e870-efb1-4523-a259-7c2d46f793bf admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:06.476248 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672e870-efb1-4523-a259-7c2d46f793bf admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:06.521939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:06.536370 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2266a7-211a-46ba-bb4a-389d1d36fa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:06.536974 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2266a7-211a-46ba-bb4a-389d1d36fa39 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:06.537250 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2266a7-211a-46ba-bb4a-389d1d36fa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:06.537549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2266a7-211a-46ba-bb4a-389d1d36fa39 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:06.538189 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2266a7-211a-46ba-bb4a-389d1d36fa39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:06.540155 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2266a7-211a-46ba-bb4a-389d1d36fa39 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:06.651921 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1171/2346] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:06 2022] POST /identity/v3/users => generated 302 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:06.656071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c850a3-0bdf-4bd7-aa00-2a8b263b1d24 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:06.666613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c850a3-0bdf-4bd7-aa00-2a8b263b1d24 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:06.671932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadecde-c3df-4e51-a123-e13934aa36bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:06.672526 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadecde-c3df-4e51-a123-e13934aa36bd admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:06.674925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadecde-c3df-4e51-a123-e13934aa36bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:06.674925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadecde-c3df-4e51-a123-e13934aa36bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:06.674925 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadecde-c3df-4e51-a123-e13934aa36bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:06.676001 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cadecde-c3df-4e51-a123-e13934aa36bd admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:06.677765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2266a7-211a-46ba-bb4a-389d1d36fa39 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:06.686200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0f2266a7-211a-46ba-bb4a-389d1d36fa39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:06.687042 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1176/2347] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:06.691551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadecde-c3df-4e51-a123-e13934aa36bd admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:06.702194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2266a7-211a-46ba-bb4a-389d1d36fa39 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:06.703703 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadecde-c3df-4e51-a123-e13934aa36bd admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:06.707506 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:06.708141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:06.708419 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:06.708692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65 admin admin] PATH_INFO: `/v3/projects/52ab389850564fed98d9974a73934699` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:06.710054 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ab389850564fed98d9974a73934699)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:06.711937 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:06.716530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64aac8-db2d-4a31-b251-6f1dde0639b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:06.717129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64aac8-db2d-4a31-b251-6f1dde0639b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:06.717440 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64aac8-db2d-4a31-b251-6f1dde0639b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:06.717749 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64aac8-db2d-4a31-b251-6f1dde0639b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:06.718391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64aac8-db2d-4a31-b251-6f1dde0639b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:06.720060 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64aac8-db2d-4a31-b251-6f1dde0639b5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:06.731095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1177/2348] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:06.735299 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64aac8-db2d-4a31-b251-6f1dde0639b5 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:06.745912 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64aac8-db2d-4a31-b251-6f1dde0639b5 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:06.750832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2d2e3-950f-4e1c-8023-9e99f79c037e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:06.751456 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2d2e3-950f-4e1c-8023-9e99f79c037e admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:06.751727 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2d2e3-950f-4e1c-8023-9e99f79c037e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:06.751993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2d2e3-950f-4e1c-8023-9e99f79c037e admin admin] PATH_INFO: `/v3/projects/1c57e5fd9aea4062b596124085309003/users/e1babe74daa240f4a3d589a47ffb8af6/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:06.769086 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2d2e3-950f-4e1c-8023-9e99f79c037e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c57e5fd9aea4062b596124085309003, user_id=e1babe74daa240f4a3d589a47ffb8af6, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:06.772169 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2d2e3-950f-4e1c-8023-9e99f79c037e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:06.845872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1178/2349] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:06 2022] PUT /identity/v3/projects/1c57e5fd9aea4062b596124085309003/users/e1babe74daa240f4a3d589a47ffb8af6/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:06.854679 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ab389850564fed98d9974a73934699', 'request_id': 'req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.857781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20c1bd-695e-422f-a6a9-822091946c12 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:06.858135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20c1bd-695e-422f-a6a9-822091946c12 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:06.858475 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20c1bd-695e-422f-a6a9-822091946c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:06.887028 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-4e20c1bd-695e-422f-a6a9-822091946c12 None None] MFA Rules not processed for user `e1babe74daa240f4a3d589a47ffb8af6`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:06.888253 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-4e20c1bd-695e-422f-a6a9-822091946c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:06.914201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ab389850564fed98d9974a73934699', 'request_id': 'req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.921638 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ab389850564fed98d9974a73934699', 'request_id': 'req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.933244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65 admin admin] The token cache is being invalidate because project 52ab389850564fed98d9974a73934699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:06.933588 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.934241 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2ec200d6-ca4b-4a87-aedb-2fb50834fc65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:06.935724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1172/2350] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:06 2022] DELETE /identity/v3/projects/52ab389850564fed98d9974a73934699 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:06.941072 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6655533-6e33-43ad-aa88-e416bb660d14 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:06.941370 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6655533-6e33-43ad-aa88-e416bb660d14 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:06.941730 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6655533-6e33-43ad-aa88-e416bb660d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:06.953688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1179/2351] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:06.958950 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20c1bd-695e-422f-a6a9-822091946c12 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:06.960435 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-4e20c1bd-695e-422f-a6a9-822091946c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:06.962173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c6655533-6e33-43ad-aa88-e416bb660d14 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:06.963339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c6655533-6e33-43ad-aa88-e416bb660d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:07.029018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1173/2352] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:07.029943 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20c1bd-695e-422f-a6a9-822091946c12 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.035126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221331b6-a5bf-4579-8a41-1827b6c31a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.035772 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221331b6-a5bf-4579-8a41-1827b6c31a38 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.036063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221331b6-a5bf-4579-8a41-1827b6c31a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.036344 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221331b6-a5bf-4579-8a41-1827b6c31a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.036981 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221331b6-a5bf-4579-8a41-1827b6c31a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.037333 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f364c77-f7eb-421e-a193-31f61eb7b919 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.037632 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f364c77-f7eb-421e-a193-31f61eb7b919 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.037904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f364c77-f7eb-421e-a193-31f61eb7b919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.039004 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221331b6-a5bf-4579-8a41-1827b6c31a38 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.055405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:07.059826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9f364c77-f7eb-421e-a193-31f61eb7b919 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:07.061019 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9f364c77-f7eb-421e-a193-31f61eb7b919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:07.070127 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1174/2353] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:07.074304 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f364c77-f7eb-421e-a193-31f61eb7b919 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.083455 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f364c77-f7eb-421e-a193-31f61eb7b919 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.088121 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0329b3-4636-4dd8-ac63-7483ebd97999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.088700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0329b3-4636-4dd8-ac63-7483ebd97999 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.088978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0329b3-4636-4dd8-ac63-7483ebd97999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.089255 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0329b3-4636-4dd8-ac63-7483ebd97999 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.089925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0329b3-4636-4dd8-ac63-7483ebd97999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:19:07.090270 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0329b3-4636-4dd8-ac63-7483ebd97999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.091865 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0329b3-4636-4dd8-ac63-7483ebd97999 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.103761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1175/2354] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:19:07.107796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0329b3-4636-4dd8-ac63-7483ebd97999 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.118070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0329b3-4636-4dd8-ac63-7483ebd97999 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.122634 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa1ca2-bd65-4ec8-876f-74643f17157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.123192 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa1ca2-bd65-4ec8-876f-74643f17157b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.123533 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa1ca2-bd65-4ec8-876f-74643f17157b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.123806 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa1ca2-bd65-4ec8-876f-74643f17157b admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.124466 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa1ca2-bd65-4ec8-876f-74643f17157b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.126355 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa1ca2-bd65-4ec8-876f-74643f17157b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.146110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1180/2355] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:06 2022] POST /identity/v3/projects => generated 405 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:07.150124 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221331b6-a5bf-4579-8a41-1827b6c31a38 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.211679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221331b6-a5bf-4579-8a41-1827b6c31a38 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.216178 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393d7bc-cef8-4d35-a290-e524338f369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.216769 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393d7bc-cef8-4d35-a290-e524338f369a admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.217041 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393d7bc-cef8-4d35-a290-e524338f369a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.217341 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393d7bc-cef8-4d35-a290-e524338f369a admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.217967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393d7bc-cef8-4d35-a290-e524338f369a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.219864 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393d7bc-cef8-4d35-a290-e524338f369a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.305803 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1176/2356] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:07 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:07.309712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa1ca2-bd65-4ec8-876f-74643f17157b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.328529 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:07.333442 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1181/2357] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:07 2022] POST /identity/v3/users => generated 309 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:07.337991 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393d7bc-cef8-4d35-a290-e524338f369a admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.348441 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393d7bc-cef8-4d35-a290-e524338f369a admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.373726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa1ca2-bd65-4ec8-876f-74643f17157b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.378768 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3620d2-cf9f-4ed8-8854-b51037533e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.379369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3620d2-cf9f-4ed8-8854-b51037533e54 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.379643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3620d2-cf9f-4ed8-8854-b51037533e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.379909 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3620d2-cf9f-4ed8-8854-b51037533e54 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.380536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3620d2-cf9f-4ed8-8854-b51037533e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.382485 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3620d2-cf9f-4ed8-8854-b51037533e54 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.405588 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee1a17-a829-4384-a129-f57263912baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.406190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee1a17-a829-4384-a129-f57263912baf admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.406462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee1a17-a829-4384-a129-f57263912baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.406728 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee1a17-a829-4384-a129-f57263912baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.407362 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee1a17-a829-4384-a129-f57263912baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.409487 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee1a17-a829-4384-a129-f57263912baf admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.419382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1182/2358] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:07.423346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee1a17-a829-4384-a129-f57263912baf admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.433627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee1a17-a829-4384-a129-f57263912baf admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.438175 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2d3c1-ac8c-4836-b519-375843403dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.440759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2d3c1-ac8c-4836-b519-375843403dba admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.440759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2d3c1-ac8c-4836-b519-375843403dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.440759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2d3c1-ac8c-4836-b519-375843403dba admin admin] PATH_INFO: `/v3/projects/ae18f314959743aba5b7eca54a9af392/users/9e5dd9e7ad1b4df5a7f43cd28b0db67b/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.453739 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2d3c1-ac8c-4836-b519-375843403dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae18f314959743aba5b7eca54a9af392, user_id=9e5dd9e7ad1b4df5a7f43cd28b0db67b, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.457049 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2d3c1-ac8c-4836-b519-375843403dba admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.458259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1177/2359] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:07 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:07.462398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3620d2-cf9f-4ed8-8854-b51037533e54 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.472889 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3620d2-cf9f-4ed8-8854-b51037533e54 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.477568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f68e8e-b825-49c7-8783-6a90e7609650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.478149 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f68e8e-b825-49c7-8783-6a90e7609650 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.478461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f68e8e-b825-49c7-8783-6a90e7609650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.478733 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f68e8e-b825-49c7-8783-6a90e7609650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.479368 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f68e8e-b825-49c7-8783-6a90e7609650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.480992 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f68e8e-b825-49c7-8783-6a90e7609650 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.490847 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1178/2360] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:07.494603 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f68e8e-b825-49c7-8783-6a90e7609650 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.504040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f68e8e-b825-49c7-8783-6a90e7609650 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.508698 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7d207-fa58-4e3c-890c-893ccc4d84f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.509258 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7d207-fa58-4e3c-890c-893ccc4d84f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.509568 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7d207-fa58-4e3c-890c-893ccc4d84f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.509841 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7d207-fa58-4e3c-890c-893ccc4d84f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.510452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7d207-fa58-4e3c-890c-893ccc4d84f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.512015 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7d207-fa58-4e3c-890c-893ccc4d84f5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.523150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1179/2361] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:07.526415 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1183/2362] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:07 2022] PUT /identity/v3/projects/ae18f314959743aba5b7eca54a9af392/users/9e5dd9e7ad1b4df5a7f43cd28b0db67b/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:07.527302 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7d207-fa58-4e3c-890c-893ccc4d84f5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.530186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2d3c1-ac8c-4836-b519-375843403dba admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.537593 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7d207-fa58-4e3c-890c-893ccc4d84f5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.589304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:07.594133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2d3c1-ac8c-4836-b519-375843403dba admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.595614 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577d29b-c940-42c2-8247-b4e18fde8cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.597119 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d29b-c940-42c2-8247-b4e18fde8cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.601943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d29b-c940-42c2-8247-b4e18fde8cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.601943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577d29b-c940-42c2-8247-b4e18fde8cfc admin admin] PATH_INFO: `/v3/projects/83b4e178192547cbb156d17254a791d9/users/14a647ff563b4edb94f24bc793f1cd21/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09447a-2cb3-4598-ab3b-9ee80645822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09447a-2cb3-4598-ab3b-9ee80645822c admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09447a-2cb3-4598-ab3b-9ee80645822c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.602161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09447a-2cb3-4598-ab3b-9ee80645822c admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.602500 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09447a-2cb3-4598-ab3b-9ee80645822c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.603382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09447a-2cb3-4598-ab3b-9ee80645822c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.613001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577d29b-c940-42c2-8247-b4e18fde8cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b4e178192547cbb156d17254a791d9, user_id=14a647ff563b4edb94f24bc793f1cd21, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.614336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1184/2363] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:07.615864 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577d29b-c940-42c2-8247-b4e18fde8cfc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.618380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09447a-2cb3-4598-ab3b-9ee80645822c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.628581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09447a-2cb3-4598-ab3b-9ee80645822c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.633237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d8dad-f1c9-4f26-95ae-2b3a6f32ab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.633899 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d8dad-f1c9-4f26-95ae-2b3a6f32ab07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.634177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d8dad-f1c9-4f26-95ae-2b3a6f32ab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.634449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d8dad-f1c9-4f26-95ae-2b3a6f32ab07 admin admin] PATH_INFO: `/v3/projects/ae18f314959743aba5b7eca54a9af392/users/9e5dd9e7ad1b4df5a7f43cd28b0db67b/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.636350 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d8dad-f1c9-4f26-95ae-2b3a6f32ab07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae18f314959743aba5b7eca54a9af392, user_id=9e5dd9e7ad1b4df5a7f43cd28b0db67b, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.639022 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d8dad-f1c9-4f26-95ae-2b3a6f32ab07 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.649819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1185/2364] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:07 2022] PUT /identity/v3/projects/ae18f314959743aba5b7eca54a9af392/users/9e5dd9e7ad1b4df5a7f43cd28b0db67b/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:07.660467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6258f-b646-41b9-a12f-45e98d72464f None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.660748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6258f-b646-41b9-a12f-45e98d72464f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.661021 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6258f-b646-41b9-a12f-45e98d72464f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.669240 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1180/2365] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:07 2022] PUT /identity/v3/projects/83b4e178192547cbb156d17254a791d9/users/14a647ff563b4edb94f24bc793f1cd21/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:07.679537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7231933-bdc4-4c08-96f9-ee178ccc7019 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.680363 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7231933-bdc4-4c08-96f9-ee178ccc7019 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.680782 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7231933-bdc4-4c08-96f9-ee178ccc7019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.695474 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-0df6258f-b646-41b9-a12f-45e98d72464f None None] MFA Rules not processed for user `9e5dd9e7ad1b4df5a7f43cd28b0db67b`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:07.697631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0df6258f-b646-41b9-a12f-45e98d72464f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:07.710355 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d7231933-bdc4-4c08-96f9-ee178ccc7019 None None] MFA Rules not processed for user `14a647ff563b4edb94f24bc793f1cd21`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:07.711566 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d7231933-bdc4-4c08-96f9-ee178ccc7019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:07.766335 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1186/2366] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:07 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:07.775232 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:07.777948 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6258f-b646-41b9-a12f-45e98d72464f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.779328 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0df6258f-b646-41b9-a12f-45e98d72464f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:07.780844 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1181/2367] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:07.787921 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7231933-bdc4-4c08-96f9-ee178ccc7019 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.840108 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6258f-b646-41b9-a12f-45e98d72464f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.843709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891707b-152f-457d-9ae5-c6fad3961fd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.844309 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891707b-152f-457d-9ae5-c6fad3961fd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.844580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891707b-152f-457d-9ae5-c6fad3961fd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.844847 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891707b-152f-457d-9ae5-c6fad3961fd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.853537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7231933-bdc4-4c08-96f9-ee178ccc7019 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:07.853682 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891707b-152f-457d-9ae5-c6fad3961fd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.855011 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891707b-152f-457d-9ae5-c6fad3961fd7 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.858149 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a19c27-45fe-4d94-9004-1e6d4dd0df7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:07.858747 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a19c27-45fe-4d94-9004-1e6d4dd0df7b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:07.859024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a19c27-45fe-4d94-9004-1e6d4dd0df7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:07.859295 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a19c27-45fe-4d94-9004-1e6d4dd0df7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:07.859932 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a19c27-45fe-4d94-9004-1e6d4dd0df7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:07.861881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a19c27-45fe-4d94-9004-1e6d4dd0df7b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:07.864502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1187/2368] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:07 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:07.951816 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1182/2369] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:07 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:07.956677 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891707b-152f-457d-9ae5-c6fad3961fd7 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:07.972606 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891707b-152f-457d-9ae5-c6fad3961fd7 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:08.000266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a19c27-45fe-4d94-9004-1e6d4dd0df7b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:08.034322 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5d37e-b175-44d9-81f2-c52b628db9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:08.034966 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5d37e-b175-44d9-81f2-c52b628db9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:08.035250 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5d37e-b175-44d9-81f2-c52b628db9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:08.035620 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5d37e-b175-44d9-81f2-c52b628db9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:08.036184 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5d37e-b175-44d9-81f2-c52b628db9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:08.038129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5d37e-b175-44d9-81f2-c52b628db9f8 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:08.049695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:08.063833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a19c27-45fe-4d94-9004-1e6d4dd0df7b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:08.069120 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0b8e9-987d-4dde-9d0a-acdab18a5255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:08.069883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b8e9-987d-4dde-9d0a-acdab18a5255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:08.070157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b8e9-987d-4dde-9d0a-acdab18a5255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:08.070422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b8e9-987d-4dde-9d0a-acdab18a5255 admin admin] PATH_INFO: `/v3/users/e1babe74daa240f4a3d589a47ffb8af6` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:08.071524 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0b8e9-987d-4dde-9d0a-acdab18a5255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1babe74daa240f4a3d589a47ffb8af6)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:08.073583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0b8e9-987d-4dde-9d0a-acdab18a5255 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:08.109186 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1188/2370] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:07 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:08.113665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5d37e-b175-44d9-81f2-c52b628db9f8 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:08.123265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5d37e-b175-44d9-81f2-c52b628db9f8 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:08.128315 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174520d-8ba4-460f-85ca-da35af50879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:08.128894 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174520d-8ba4-460f-85ca-da35af50879a admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:08.129165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174520d-8ba4-460f-85ca-da35af50879a admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:08.129472 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174520d-8ba4-460f-85ca-da35af50879a admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:08.130177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174520d-8ba4-460f-85ca-da35af50879a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:08.131709 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174520d-8ba4-460f-85ca-da35af50879a admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:08.141822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1189/2371] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:08.145887 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174520d-8ba4-460f-85ca-da35af50879a admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:08.155250 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174520d-8ba4-460f-85ca-da35af50879a admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:08.160463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd0be4-d181-4143-8feb-302814151b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:08.163691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd0be4-d181-4143-8feb-302814151b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:08.163691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd0be4-d181-4143-8feb-302814151b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:08.163691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd0be4-d181-4143-8feb-302814151b78 admin admin] PATH_INFO: `/v3/projects/d6ba8d8e6b6c4c2b84486d1310ef25d0/users/409a45595e6448e5a5d4376ffb647e1c/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:08.177997 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd0be4-d181-4143-8feb-302814151b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ba8d8e6b6c4c2b84486d1310ef25d0, user_id=409a45595e6448e5a5d4376ffb647e1c, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:08.180872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd0be4-d181-4143-8feb-302814151b78 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:08.246783 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-85b0b8e9-987d-4dde-9d0a-acdab18a5255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1babe74daa240f4a3d589a47ffb8af6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:08.247428 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-85b0b8e9-987d-4dde-9d0a-acdab18a5255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1babe74daa240f4a3d589a47ffb8af6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:08.254842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-85b0b8e9-987d-4dde-9d0a-acdab18a5255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1babe74daa240f4a3d589a47ffb8af6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:08.262929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1190/2372] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:08 2022] PUT /identity/v3/projects/d6ba8d8e6b6c4c2b84486d1310ef25d0/users/409a45595e6448e5a5d4376ffb647e1c/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:08.266893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd0be4-d181-4143-8feb-302814151b78 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:08.269006 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-09bd0be4-d181-4143-8feb-302814151b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:08.326097 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-85b0b8e9-987d-4dde-9d0a-acdab18a5255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1babe74daa240f4a3d589a47ffb8af6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:08.336481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd0be4-d181-4143-8feb-302814151b78 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:08.341393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-85b0b8e9-987d-4dde-9d0a-acdab18a5255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1babe74daa240f4a3d589a47ffb8af6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:08.341883 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912369d-43f1-4c7f-8cd4-6e1931483104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:08.342491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912369d-43f1-4c7f-8cd4-6e1931483104 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:08.342779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912369d-43f1-4c7f-8cd4-6e1931483104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:08.343046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912369d-43f1-4c7f-8cd4-6e1931483104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:08.343695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912369d-43f1-4c7f-8cd4-6e1931483104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:08.356973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912369d-43f1-4c7f-8cd4-6e1931483104 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:08.357092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1183/2373] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:07 2022] DELETE /identity/v3/users/e1babe74daa240f4a3d589a47ffb8af6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:08.357199 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1191/2374] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:08.362565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912369d-43f1-4c7f-8cd4-6e1931483104 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:08.362994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fba7c-8478-487d-8f93-3646f0ce353a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:08.363277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fba7c-8478-487d-8f93-3646f0ce353a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:08.363552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fba7c-8478-487d-8f93-3646f0ce353a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:08.370929 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:08.372790 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912369d-43f1-4c7f-8cd4-6e1931483104 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:08.383618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a28fba7c-8478-487d-8f93-3646f0ce353a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:08.384866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a28fba7c-8478-487d-8f93-3646f0ce353a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:08.430696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f53b7-fdb7-42e1-9982-158167b8939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:08.431381 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f53b7-fdb7-42e1-9982-158167b8939d admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:08.431654 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f53b7-fdb7-42e1-9982-158167b8939d admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:08.431914 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f53b7-fdb7-42e1-9982-158167b8939d admin admin] PATH_INFO: `/v3/projects/d6ba8d8e6b6c4c2b84486d1310ef25d0/users/409a45595e6448e5a5d4376ffb647e1c/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:08.433884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f53b7-fdb7-42e1-9982-158167b8939d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6ba8d8e6b6c4c2b84486d1310ef25d0, user_id=409a45595e6448e5a5d4376ffb647e1c, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:08.436488 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f53b7-fdb7-42e1-9982-158167b8939d admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:08.447392 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1192/2375] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:08 2022] PUT /identity/v3/projects/d6ba8d8e6b6c4c2b84486d1310ef25d0/users/409a45595e6448e5a5d4376ffb647e1c/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:08.448571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1184/2376] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:08.458754 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f53b7-fdb7-42e1-9982-158167b8939d admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:08.459153 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c860c-9326-4694-9d5a-912bc86d83b6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:08.459434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c860c-9326-4694-9d5a-912bc86d83b6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:08.459767 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c860c-9326-4694-9d5a-912bc86d83b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:08.460529 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2a6f53b7-fdb7-42e1-9982-158167b8939d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:08.489899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f23c860c-9326-4694-9d5a-912bc86d83b6 None None] MFA Rules not processed for user `409a45595e6448e5a5d4376ffb647e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:08.491120 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f23c860c-9326-4694-9d5a-912bc86d83b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:08.521565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f53b7-fdb7-42e1-9982-158167b8939d admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:08.525182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4b541-5e59-40e3-abe1-f5a5276aabda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:08.525804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4b541-5e59-40e3-abe1-f5a5276aabda service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:08.526081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4b541-5e59-40e3-abe1-f5a5276aabda service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:08.526349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4b541-5e59-40e3-abe1-f5a5276aabda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:08.530704 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:08.562190 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1185/2377] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:08.573770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c860c-9326-4694-9d5a-912bc86d83b6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:08.575135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f23c860c-9326-4694-9d5a-912bc86d83b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:08.590076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4b541-5e59-40e3-abe1-f5a5276aabda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:08.591560 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4b541-5e59-40e3-abe1-f5a5276aabda service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:08.603815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1193/2378] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:08.632980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c860c-9326-4694-9d5a-912bc86d83b6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:08.636875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ddd17-edcc-43d3-9020-6efba0339bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:08.637502 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ddd17-edcc-43d3-9020-6efba0339bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:08.637778 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ddd17-edcc-43d3-9020-6efba0339bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:08.638043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ddd17-edcc-43d3-9020-6efba0339bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:08.648292 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ddd17-edcc-43d3-9020-6efba0339bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:08.649759 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ddd17-edcc-43d3-9020-6efba0339bc7 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:08.659690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1186/2379] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:08.805245 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4b541-5e59-40e3-abe1-f5a5276aabda service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:08.816647 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4b541-5e59-40e3-abe1-f5a5276aabda service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:08.820573 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c2c29-05c3-4271-9a59-0611afccce65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:08.821198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c2c29-05c3-4271-9a59-0611afccce65 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:08.821478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c2c29-05c3-4271-9a59-0611afccce65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:08.821739 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c2c29-05c3-4271-9a59-0611afccce65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:08.823508 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b46c2c29-05c3-4271-9a59-0611afccce65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:08.885242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c2c29-05c3-4271-9a59-0611afccce65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:08.886908 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c2c29-05c3-4271-9a59-0611afccce65 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:08.896124 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1194/2380] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:09.008162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ddd17-edcc-43d3-9020-6efba0339bc7 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:09.009780 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-464ddd17-edcc-43d3-9020-6efba0339bc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:09.024378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ddd17-edcc-43d3-9020-6efba0339bc7 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:09.029068 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:09.029736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:09.030013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:09.030345 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] PATH_INFO: `/v3/projects/1c57e5fd9aea4062b596124085309003` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:09.031483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c57e5fd9aea4062b596124085309003)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:09.034429 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:09.126185 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:09.143235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c57e5fd9aea4062b596124085309003', 'request_id': 'req-cc799e0f-87de-4c14-b3cb-db237a291f70'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.206282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c57e5fd9aea4062b596124085309003', 'request_id': 'req-cc799e0f-87de-4c14-b3cb-db237a291f70'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.214546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c57e5fd9aea4062b596124085309003', 'request_id': 'req-cc799e0f-87de-4c14-b3cb-db237a291f70'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.226194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] The token cache is being invalidate because project 1c57e5fd9aea4062b596124085309003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:09.226483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.227167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.228724 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1187/2381] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:09 2022] DELETE /identity/v3/projects/1c57e5fd9aea4062b596124085309003 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:09.232572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c2c29-05c3-4271-9a59-0611afccce65 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:09.243775 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c2c29-05c3-4271-9a59-0611afccce65 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:09.303252 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012c01c-9768-4abe-862a-f76b95c930eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:09.303868 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012c01c-9768-4abe-862a-f76b95c930eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:09.304141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012c01c-9768-4abe-862a-f76b95c930eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:09.304432 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012c01c-9768-4abe-862a-f76b95c930eb admin admin] PATH_INFO: `/v3/users/9e5dd9e7ad1b4df5a7f43cd28b0db67b` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:09.305859 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012c01c-9768-4abe-862a-f76b95c930eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5dd9e7ad1b4df5a7f43cd28b0db67b)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:09.307743 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012c01c-9768-4abe-862a-f76b95c930eb admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:09.381311 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:09.382758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:09.396550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc799e0f-87de-4c14-b3cb-db237a291f70 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:09.401156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:09.401807 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:09.402120 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:09.402388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] PATH_INFO: `/v3/users/14a647ff563b4edb94f24bc793f1cd21` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:09.403555 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a647ff563b4edb94f24bc793f1cd21)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:09.405510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:09.475579 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:09.480630 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7012c01c-9768-4abe-862a-f76b95c930eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5dd9e7ad1b4df5a7f43cd28b0db67b'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.481272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7012c01c-9768-4abe-862a-f76b95c930eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5dd9e7ad1b4df5a7f43cd28b0db67b'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.493505 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7012c01c-9768-4abe-862a-f76b95c930eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5dd9e7ad1b4df5a7f43cd28b0db67b'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.494176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7012c01c-9768-4abe-862a-f76b95c930eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5dd9e7ad1b4df5a7f43cd28b0db67b'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.548551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-7012c01c-9768-4abe-862a-f76b95c930eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5dd9e7ad1b4df5a7f43cd28b0db67b'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.562806 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1195/2382] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:09 2022] DELETE /identity/v3/users/9e5dd9e7ad1b4df5a7f43cd28b0db67b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:09.567320 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a647ff563b4edb94f24bc793f1cd21'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.567609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a647ff563b4edb94f24bc793f1cd21'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.574883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a647ff563b4edb94f24bc793f1cd21'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.640148 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a647ff563b4edb94f24bc793f1cd21'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.653806 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a647ff563b4edb94f24bc793f1cd21'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:09.660135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1188/2383] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:09 2022] DELETE /identity/v3/users/14a647ff563b4edb94f24bc793f1cd21 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:09.664711 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9989f8f-9a0f-458c-a541-9c21a1f59507 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:09.664992 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9989f8f-9a0f-458c-a541-9c21a1f59507 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:09.666857 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9989f8f-9a0f-458c-a541-9c21a1f59507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:09.685036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e9989f8f-9a0f-458c-a541-9c21a1f59507 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:09.686268 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e9989f8f-9a0f-458c-a541-9c21a1f59507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:09.746809 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1196/2384] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:09.764866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:09.766326 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:09.827255 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fc224-4307-40ba-a5fd-d4961ddff631 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:09.831510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da06cd-9781-4a0d-9aa8-0cb8cc44cc1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:09.832110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da06cd-9781-4a0d-9aa8-0cb8cc44cc1b service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:09.832384 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da06cd-9781-4a0d-9aa8-0cb8cc44cc1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:09.832649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da06cd-9781-4a0d-9aa8-0cb8cc44cc1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:09.842526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da06cd-9781-4a0d-9aa8-0cb8cc44cc1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:09.843933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da06cd-9781-4a0d-9aa8-0cb8cc44cc1b service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:09.853605 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1189/2385] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:09.963737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9989f8f-9a0f-458c-a541-9c21a1f59507 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:09.965416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e9989f8f-9a0f-458c-a541-9c21a1f59507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:09.978237 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9989f8f-9a0f-458c-a541-9c21a1f59507 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:09.983223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86541c-9399-4efb-adf2-b705336969b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:09.983863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86541c-9399-4efb-adf2-b705336969b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:09.984144 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86541c-9399-4efb-adf2-b705336969b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:09.984958 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86541c-9399-4efb-adf2-b705336969b7 admin admin] PATH_INFO: `/v3/projects/ae18f314959743aba5b7eca54a9af392` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:09.986210 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86541c-9399-4efb-adf2-b705336969b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae18f314959743aba5b7eca54a9af392)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:09.990814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86541c-9399-4efb-adf2-b705336969b7 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:10.116449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-2b86541c-9399-4efb-adf2-b705336969b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae18f314959743aba5b7eca54a9af392', 'request_id': 'req-2b86541c-9399-4efb-adf2-b705336969b7'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:10.256433 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-2b86541c-9399-4efb-adf2-b705336969b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae18f314959743aba5b7eca54a9af392', 'request_id': 'req-2b86541c-9399-4efb-adf2-b705336969b7'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:10.263573 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-2b86541c-9399-4efb-adf2-b705336969b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae18f314959743aba5b7eca54a9af392', 'request_id': 'req-2b86541c-9399-4efb-adf2-b705336969b7'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:10.277691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-2b86541c-9399-4efb-adf2-b705336969b7 admin admin] The token cache is being invalidate because project ae18f314959743aba5b7eca54a9af392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:10.277995 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-2b86541c-9399-4efb-adf2-b705336969b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:10.278733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-2b86541c-9399-4efb-adf2-b705336969b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:10.280263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1197/2386] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:09 2022] DELETE /identity/v3/projects/ae18f314959743aba5b7eca54a9af392 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:10.285453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81731cec-de40-4e33-a6d0-b764fad27c14 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:10.285938 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81731cec-de40-4e33-a6d0-b764fad27c14 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:10.286057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81731cec-de40-4e33-a6d0-b764fad27c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:10.308968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-81731cec-de40-4e33-a6d0-b764fad27c14 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:10.310578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-81731cec-de40-4e33-a6d0-b764fad27c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:10.337227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:10.376438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1190/2387] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:10.384667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93d59-a1ac-4905-8b2d-98f1f070c7d4 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:10.384967 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93d59-a1ac-4905-8b2d-98f1f070c7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:10.385273 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93d59-a1ac-4905-8b2d-98f1f070c7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:10.407247 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-87e93d59-a1ac-4905-8b2d-98f1f070c7d4 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:10.409126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-87e93d59-a1ac-4905-8b2d-98f1f070c7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:10.417151 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1198/2388] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:10.423357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81731cec-de40-4e33-a6d0-b764fad27c14 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:10.435502 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81731cec-de40-4e33-a6d0-b764fad27c14 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:10.449463 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7a964-1d4b-4e29-8b77-5a25de50934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:10.449463 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7a964-1d4b-4e29-8b77-5a25de50934a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:10.449463 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7a964-1d4b-4e29-8b77-5a25de50934a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:10.449463 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7a964-1d4b-4e29-8b77-5a25de50934a admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:10.449788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7a964-1d4b-4e29-8b77-5a25de50934a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:19:10.449788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7a964-1d4b-4e29-8b77-5a25de50934a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:10.450193 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7a964-1d4b-4e29-8b77-5a25de50934a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:10.452196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e93d59-a1ac-4905-8b2d-98f1f070c7d4 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:10.454714 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-87e93d59-a1ac-4905-8b2d-98f1f070c7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:10.468499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1191/2389] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:19:10.474425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e93d59-a1ac-4905-8b2d-98f1f070c7d4 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:10.479212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:10.479834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:10.480105 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:10.483776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] PATH_INFO: `/v3/projects/83b4e178192547cbb156d17254a791d9` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:10.483776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b4e178192547cbb156d17254a791d9)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:10.483776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:10.486008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7a964-1d4b-4e29-8b77-5a25de50934a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:10.496957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7a964-1d4b-4e29-8b77-5a25de50934a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:10.503030 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce179112-49c1-4e53-8b23-50c5979b41bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:10.503635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce179112-49c1-4e53-8b23-50c5979b41bd admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:10.503918 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce179112-49c1-4e53-8b23-50c5979b41bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:10.504406 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce179112-49c1-4e53-8b23-50c5979b41bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:10.504981 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce179112-49c1-4e53-8b23-50c5979b41bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:10.506918 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce179112-49c1-4e53-8b23-50c5979b41bd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:10.646272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:10.651135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1192/2390] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:10 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:10.652160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce179112-49c1-4e53-8b23-50c5979b41bd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:10.660335 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b4e178192547cbb156d17254a791d9', 'request_id': 'req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:10.714442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce179112-49c1-4e53-8b23-50c5979b41bd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:10.719052 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f4ca7-992a-4e11-9b39-c5d55918b04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:10.719648 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f4ca7-992a-4e11-9b39-c5d55918b04c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:10.719926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f4ca7-992a-4e11-9b39-c5d55918b04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:10.720195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f4ca7-992a-4e11-9b39-c5d55918b04c admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:10.720935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f4ca7-992a-4e11-9b39-c5d55918b04c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:10.723497 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f4ca7-992a-4e11-9b39-c5d55918b04c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:10.760513 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b4e178192547cbb156d17254a791d9', 'request_id': 'req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:10.767204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b4e178192547cbb156d17254a791d9', 'request_id': 'req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:10.777988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] The token cache is being invalidate because project 83b4e178192547cbb156d17254a791d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:10.778270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:10.778898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:10.780453 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1199/2391] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:10 2022] DELETE /identity/v3/projects/83b4e178192547cbb156d17254a791d9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:10.785052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:10.786419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:10.849201 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ceebb-45cc-4ba1-bd59-2708073c4c24 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:10.853865 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1193/2392] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:10 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:10.854286 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237eb87-1426-4576-9a06-120097d22004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:10.854909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237eb87-1426-4576-9a06-120097d22004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:10.855327 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237eb87-1426-4576-9a06-120097d22004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:10.855721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237eb87-1426-4576-9a06-120097d22004 admin admin] PATH_INFO: `/v3/users/409a45595e6448e5a5d4376ffb647e1c` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:10.856078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f4ca7-992a-4e11-9b39-c5d55918b04c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:10.856883 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237eb87-1426-4576-9a06-120097d22004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=409a45595e6448e5a5d4376ffb647e1c)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:10.857781 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c59f4ca7-992a-4e11-9b39-c5d55918b04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:10.858844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237eb87-1426-4576-9a06-120097d22004 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:10.869703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f4ca7-992a-4e11-9b39-c5d55918b04c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:10.874444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79ccc5-72c7-4bce-bd88-cac0073a9003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:10.875037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79ccc5-72c7-4bce-bd88-cac0073a9003 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:10.875320 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79ccc5-72c7-4bce-bd88-cac0073a9003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:10.875671 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79ccc5-72c7-4bce-bd88-cac0073a9003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:10.876310 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79ccc5-72c7-4bce-bd88-cac0073a9003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:10.878672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79ccc5-72c7-4bce-bd88-cac0073a9003 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:10.889060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1194/2393] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:10.896774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79ccc5-72c7-4bce-bd88-cac0073a9003 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:10.903060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79ccc5-72c7-4bce-bd88-cac0073a9003 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:10.907617 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17f0f9-5957-48b2-ae41-11faf249ee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:10.908179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17f0f9-5957-48b2-ae41-11faf249ee85 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:10.908586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17f0f9-5957-48b2-ae41-11faf249ee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:10.908873 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17f0f9-5957-48b2-ae41-11faf249ee85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:10.909582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17f0f9-5957-48b2-ae41-11faf249ee85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:10.911133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17f0f9-5957-48b2-ae41-11faf249ee85 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:10.922370 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1195/2394] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:10.926220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17f0f9-5957-48b2-ae41-11faf249ee85 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:10.935773 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17f0f9-5957-48b2-ae41-11faf249ee85 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:10.940840 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65d66d-a772-430f-9773-af90d179aa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:10.941475 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65d66d-a772-430f-9773-af90d179aa7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:10.941754 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65d66d-a772-430f-9773-af90d179aa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:10.942020 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65d66d-a772-430f-9773-af90d179aa7f admin admin] PATH_INFO: `/v3/projects/dd98aab47b7546f492d7f5489f2bae50/users/99c449feefd1404e8fe8122c71c5439e/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:10.956758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65d66d-a772-430f-9773-af90d179aa7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd98aab47b7546f492d7f5489f2bae50, user_id=99c449feefd1404e8fe8122c71c5439e, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:10.959430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65d66d-a772-430f-9773-af90d179aa7f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:11.087265 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1196/2395] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:10 2022] PUT /identity/v3/projects/dd98aab47b7546f492d7f5489f2bae50/users/99c449feefd1404e8fe8122c71c5439e/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:11.098594 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f5b5c-6d44-4819-9dd2-e3d72d2c5dd0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:11.098876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f5b5c-6d44-4819-9dd2-e3d72d2c5dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:11.099169 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f5b5c-6d44-4819-9dd2-e3d72d2c5dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:11.128909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5237eb87-1426-4576-9a06-120097d22004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409a45595e6448e5a5d4376ffb647e1c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:11.129465 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ce3f5b5c-6d44-4819-9dd2-e3d72d2c5dd0 None None] MFA Rules not processed for user `99c449feefd1404e8fe8122c71c5439e`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:11.129583 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5237eb87-1426-4576-9a06-120097d22004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409a45595e6448e5a5d4376ffb647e1c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:11.130770 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ce3f5b5c-6d44-4819-9dd2-e3d72d2c5dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:11.143566 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5237eb87-1426-4576-9a06-120097d22004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409a45595e6448e5a5d4376ffb647e1c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:11.144439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5237eb87-1426-4576-9a06-120097d22004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409a45595e6448e5a5d4376ffb647e1c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:11.195907 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1197/2396] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:11.200393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f5b5c-6d44-4819-9dd2-e3d72d2c5dd0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:11.201694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ce3f5b5c-6d44-4819-9dd2-e3d72d2c5dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:11.264587 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f5b5c-6d44-4819-9dd2-e3d72d2c5dd0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:11.269187 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b88b8-86c8-4f1a-8f93-d560fec30621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:11.273532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b88b8-86c8-4f1a-8f93-d560fec30621 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:11.273532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b88b8-86c8-4f1a-8f93-d560fec30621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:11.273532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b88b8-86c8-4f1a-8f93-d560fec30621 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:11.273532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b88b8-86c8-4f1a-8f93-d560fec30621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:11.273532 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b88b8-86c8-4f1a-8f93-d560fec30621 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:11.295797 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5237eb87-1426-4576-9a06-120097d22004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409a45595e6448e5a5d4376ffb647e1c'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:11.309358 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1200/2397] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:10 2022] DELETE /identity/v3/users/409a45595e6448e5a5d4376ffb647e1c => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:11.406100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1198/2398] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:11 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:11.407296 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237eb87-1426-4576-9a06-120097d22004 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:11.429490 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:11.467773 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237eb87-1426-4576-9a06-120097d22004 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:11.523723 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21810154-60a6-4877-84de-08d979bb3b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:11.524535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21810154-60a6-4877-84de-08d979bb3b79 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:11.524910 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21810154-60a6-4877-84de-08d979bb3b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:11.525326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21810154-60a6-4877-84de-08d979bb3b79 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:11.526402 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21810154-60a6-4877-84de-08d979bb3b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:11.528270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21810154-60a6-4877-84de-08d979bb3b79 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:11.640632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1201/2399] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:11 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:11.644675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b88b8-86c8-4f1a-8f93-d560fec30621 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:11.646109 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:11.655083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b88b8-86c8-4f1a-8f93-d560fec30621 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:11.660288 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074942b-6276-4926-8a69-b5485ab4929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:11.660884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074942b-6276-4926-8a69-b5485ab4929e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:11.661163 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074942b-6276-4926-8a69-b5485ab4929e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:11.661464 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074942b-6276-4926-8a69-b5485ab4929e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:11.662105 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074942b-6276-4926-8a69-b5485ab4929e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:11.663678 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074942b-6276-4926-8a69-b5485ab4929e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:11.675110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1199/2400] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:11.679886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21810154-60a6-4877-84de-08d979bb3b79 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:11.690207 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21810154-60a6-4877-84de-08d979bb3b79 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:11.694904 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aea52-600e-4032-bfcc-c32eb1f4b941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:11.695544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aea52-600e-4032-bfcc-c32eb1f4b941 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:11.695817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aea52-600e-4032-bfcc-c32eb1f4b941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:11.696084 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81aea52-600e-4032-bfcc-c32eb1f4b941 admin admin] PATH_INFO: `/v3/projects/1627d90d31fd417f91b8db99d7cc0104/users/7f3ebdaf93ae4cf9ad4dfd8e13c9f149/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:11.710633 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aea52-600e-4032-bfcc-c32eb1f4b941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1627d90d31fd417f91b8db99d7cc0104, user_id=7f3ebdaf93ae4cf9ad4dfd8e13c9f149, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:11.713375 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81aea52-600e-4032-bfcc-c32eb1f4b941 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:11.824628 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074942b-6276-4926-8a69-b5485ab4929e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:11.826477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7074942b-6276-4926-8a69-b5485ab4929e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:11.835953 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1202/2401] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:11 2022] PUT /identity/v3/projects/1627d90d31fd417f91b8db99d7cc0104/users/7f3ebdaf93ae4cf9ad4dfd8e13c9f149/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:11.839455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aea52-600e-4032-bfcc-c32eb1f4b941 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:11.842567 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074942b-6276-4926-8a69-b5485ab4929e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:11.902261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc182fb2-e099-4377-8bd8-c86e02c46225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:11.902883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc182fb2-e099-4377-8bd8-c86e02c46225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:11.903144 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc182fb2-e099-4377-8bd8-c86e02c46225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:11.903408 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc182fb2-e099-4377-8bd8-c86e02c46225 admin admin] PATH_INFO: `/v3/projects/d6ba8d8e6b6c4c2b84486d1310ef25d0` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:11.904511 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc182fb2-e099-4377-8bd8-c86e02c46225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6ba8d8e6b6c4c2b84486d1310ef25d0)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:11.905159 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81aea52-600e-4032-bfcc-c32eb1f4b941 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:11.906427 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc182fb2-e099-4377-8bd8-c86e02c46225 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:11.910824 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17a85b-01c8-4b54-a565-780f35c6cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:11.911425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17a85b-01c8-4b54-a565-780f35c6cabe admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:11.911700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17a85b-01c8-4b54-a565-780f35c6cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:11.911969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17a85b-01c8-4b54-a565-780f35c6cabe admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:11.916238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17a85b-01c8-4b54-a565-780f35c6cabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:11.916238 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17a85b-01c8-4b54-a565-780f35c6cabe admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:11.925862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1203/2402] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:11.929909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17a85b-01c8-4b54-a565-780f35c6cabe admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:11.939697 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17a85b-01c8-4b54-a565-780f35c6cabe admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:11.944776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d7c1f-a401-4c12-bedd-f769340e4e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:11.944920 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d7c1f-a401-4c12-bedd-f769340e4e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:11.945179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d7c1f-a401-4c12-bedd-f769340e4e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:11.945479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d7c1f-a401-4c12-bedd-f769340e4e70 admin admin] PATH_INFO: `/v3/projects/1627d90d31fd417f91b8db99d7cc0104/users/7f3ebdaf93ae4cf9ad4dfd8e13c9f149/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:11.947387 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d7c1f-a401-4c12-bedd-f769340e4e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1627d90d31fd417f91b8db99d7cc0104, user_id=7f3ebdaf93ae4cf9ad4dfd8e13c9f149, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:11.950010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d7c1f-a401-4c12-bedd-f769340e4e70 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:11.960801 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1204/2403] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:11 2022] PUT /identity/v3/projects/1627d90d31fd417f91b8db99d7cc0104/users/7f3ebdaf93ae4cf9ad4dfd8e13c9f149/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:11.971701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6ee21-ed59-4a0a-9582-7199b41a476f None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:11.971984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6ee21-ed59-4a0a-9582-7199b41a476f None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:11.973778 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6ee21-ed59-4a0a-9582-7199b41a476f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:12.000380 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-15e6ee21-ed59-4a0a-9582-7199b41a476f None None] MFA Rules not processed for user `7f3ebdaf93ae4cf9ad4dfd8e13c9f149`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:12.001646 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-15e6ee21-ed59-4a0a-9582-7199b41a476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:12.010398 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dc182fb2-e099-4377-8bd8-c86e02c46225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6ba8d8e6b6c4c2b84486d1310ef25d0', 'request_id': 'req-dc182fb2-e099-4377-8bd8-c86e02c46225'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:12.069223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1205/2404] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:12.080819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6ee21-ed59-4a0a-9582-7199b41a476f None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:12.082190 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-15e6ee21-ed59-4a0a-9582-7199b41a476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:12.085990 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dc182fb2-e099-4377-8bd8-c86e02c46225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6ba8d8e6b6c4c2b84486d1310ef25d0', 'request_id': 'req-dc182fb2-e099-4377-8bd8-c86e02c46225'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:12.093232 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dc182fb2-e099-4377-8bd8-c86e02c46225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6ba8d8e6b6c4c2b84486d1310ef25d0', 'request_id': 'req-dc182fb2-e099-4377-8bd8-c86e02c46225'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:12.104799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dc182fb2-e099-4377-8bd8-c86e02c46225 admin admin] The token cache is being invalidate because project d6ba8d8e6b6c4c2b84486d1310ef25d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:12.105160 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dc182fb2-e099-4377-8bd8-c86e02c46225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:12.105898 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dc182fb2-e099-4377-8bd8-c86e02c46225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:12.107573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1200/2405] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:11 2022] DELETE /identity/v3/projects/d6ba8d8e6b6c4c2b84486d1310ef25d0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:12.109576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:12.112534 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fc8ee-6705-48bc-9d2f-4944c56d4dcb None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:12.112808 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fc8ee-6705-48bc-9d2f-4944c56d4dcb None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:12.113083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fc8ee-6705-48bc-9d2f-4944c56d4dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:12.132237 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f00fc8ee-6705-48bc-9d2f-4944c56d4dcb None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:12.133497 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f00fc8ee-6705-48bc-9d2f-4944c56d4dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:12.139578 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6ee21-ed59-4a0a-9582-7199b41a476f None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:12.145203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2820fc-8a85-4be9-8864-1ba62d6e3113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:12.145781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2820fc-8a85-4be9-8864-1ba62d6e3113 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:12.148455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2820fc-8a85-4be9-8864-1ba62d6e3113 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:12.148455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2820fc-8a85-4be9-8864-1ba62d6e3113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:12.148455 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6d2820fc-8a85-4be9-8864-1ba62d6e3113 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:12.161052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2820fc-8a85-4be9-8864-1ba62d6e3113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:12.162646 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2820fc-8a85-4be9-8864-1ba62d6e3113 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:12.172871 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1206/2406] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:12.194815 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1201/2407] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:12.202599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41450494-4ce4-481a-adfc-ae310f6aeb3a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:12.202907 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41450494-4ce4-481a-adfc-ae310f6aeb3a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:12.203171 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41450494-4ce4-481a-adfc-ae310f6aeb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:12.224139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-41450494-4ce4-481a-adfc-ae310f6aeb3a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:12.225379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-41450494-4ce4-481a-adfc-ae310f6aeb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:12.233196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1207/2408] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:12.237529 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fc8ee-6705-48bc-9d2f-4944c56d4dcb None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:12.247583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fc8ee-6705-48bc-9d2f-4944c56d4dcb None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:12.252736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e98dc-8507-4be8-844e-060289c2c37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:12.253471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e98dc-8507-4be8-844e-060289c2c37a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:12.253757 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e98dc-8507-4be8-844e-060289c2c37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:12.254021 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e98dc-8507-4be8-844e-060289c2c37a admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:12.254817 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e98dc-8507-4be8-844e-060289c2c37a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:19:12.255120 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e98dc-8507-4be8-844e-060289c2c37a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:12.256902 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e98dc-8507-4be8-844e-060289c2c37a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:12.273319 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1202/2409] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:19:12.274358 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41450494-4ce4-481a-adfc-ae310f6aeb3a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:12.284742 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41450494-4ce4-481a-adfc-ae310f6aeb3a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:12.289483 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d2cf5-eefc-4a81-96d3-fa260a1bd3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:12.290081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d2cf5-eefc-4a81-96d3-fa260a1bd3df admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:12.290379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d2cf5-eefc-4a81-96d3-fa260a1bd3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:12.290688 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d2cf5-eefc-4a81-96d3-fa260a1bd3df admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:12.291288 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d2cf5-eefc-4a81-96d3-fa260a1bd3df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:12.293197 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d2cf5-eefc-4a81-96d3-fa260a1bd3df admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:12.371623 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:12.431232 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e98dc-8507-4be8-844e-060289c2c37a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:12.432993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1c1e98dc-8507-4be8-844e-060289c2c37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:12.445503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e98dc-8507-4be8-844e-060289c2c37a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:12.449003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427218bf-97b4-46d1-b7b4-fc74c3ec293d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:12.449620 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427218bf-97b4-46d1-b7b4-fc74c3ec293d service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:12.449897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427218bf-97b4-46d1-b7b4-fc74c3ec293d service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:12.450194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427218bf-97b4-46d1-b7b4-fc74c3ec293d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:12.451868 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-427218bf-97b4-46d1-b7b4-fc74c3ec293d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:12.473424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1208/2410] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:12 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:12.474485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d2cf5-eefc-4a81-96d3-fa260a1bd3df admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:12.517133 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427218bf-97b4-46d1-b7b4-fc74c3ec293d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:12.519368 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427218bf-97b4-46d1-b7b4-fc74c3ec293d service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:12.528505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1203/2411] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:12.538528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d2cf5-eefc-4a81-96d3-fa260a1bd3df admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:12.543204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b8a3c-be11-4759-8e48-ed716e8c1ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:12.543808 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b8a3c-be11-4759-8e48-ed716e8c1ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:12.544083 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b8a3c-be11-4759-8e48-ed716e8c1ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:12.544361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b8a3c-be11-4759-8e48-ed716e8c1ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:12.544973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b8a3c-be11-4759-8e48-ed716e8c1ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:12.546983 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b8a3c-be11-4759-8e48-ed716e8c1ae2 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:12.725603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1209/2412] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:12 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:12.729925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427218bf-97b4-46d1-b7b4-fc74c3ec293d service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:12.741365 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427218bf-97b4-46d1-b7b4-fc74c3ec293d service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:12.745958 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f67328-50be-48e8-a21b-d97b6b3188e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:12.746550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f67328-50be-48e8-a21b-d97b6b3188e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:12.746830 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f67328-50be-48e8-a21b-d97b6b3188e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:12.747321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f67328-50be-48e8-a21b-d97b6b3188e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:12.747963 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f67328-50be-48e8-a21b-d97b6b3188e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:12.749581 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f67328-50be-48e8-a21b-d97b6b3188e3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:12.760238 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1204/2413] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:12.764571 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b8a3c-be11-4759-8e48-ed716e8c1ae2 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:12.774731 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b8a3c-be11-4759-8e48-ed716e8c1ae2 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:12.779307 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a277de6-36c9-4270-b39c-a09f9462a2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:12.779889 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a277de6-36c9-4270-b39c-a09f9462a2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:12.780162 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a277de6-36c9-4270-b39c-a09f9462a2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:12.780426 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a277de6-36c9-4270-b39c-a09f9462a2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:12.781056 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a277de6-36c9-4270-b39c-a09f9462a2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:12.782755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a277de6-36c9-4270-b39c-a09f9462a2c0 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:12.792841 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1210/2414] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:12.796883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f67328-50be-48e8-a21b-d97b6b3188e3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:12.807608 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f67328-50be-48e8-a21b-d97b6b3188e3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:12.812104 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6846190-4ef5-41c4-977a-64fdc48bade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:12.812732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6846190-4ef5-41c4-977a-64fdc48bade0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:12.813005 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6846190-4ef5-41c4-977a-64fdc48bade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:12.813275 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6846190-4ef5-41c4-977a-64fdc48bade0 admin admin] PATH_INFO: `/v3/projects/502508e000df4983b5ef2bb49ebf58a0/users/bf1dcba45d174febb788a6eaaaf0d329/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:12.828612 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6846190-4ef5-41c4-977a-64fdc48bade0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502508e000df4983b5ef2bb49ebf58a0, user_id=bf1dcba45d174febb788a6eaaaf0d329, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:12.831388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6846190-4ef5-41c4-977a-64fdc48bade0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:12.903432 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1205/2415] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:12 2022] PUT /identity/v3/projects/502508e000df4983b5ef2bb49ebf58a0/users/bf1dcba45d174febb788a6eaaaf0d329/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:12.914013 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8c9e6-c465-4b96-9a02-879fd9274acb None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:12.914293 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8c9e6-c465-4b96-9a02-879fd9274acb None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:12.914560 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8c9e6-c465-4b96-9a02-879fd9274acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:12.936119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:12.944313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e9b8c9e6-c465-4b96-9a02-879fd9274acb None None] MFA Rules not processed for user `bf1dcba45d174febb788a6eaaaf0d329`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:12.945553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e9b8c9e6-c465-4b96-9a02-879fd9274acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:13.010171 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1211/2416] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:13.014620 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6846190-4ef5-41c4-977a-64fdc48bade0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:13.041053 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:13.084783 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6846190-4ef5-41c4-977a-64fdc48bade0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:13.089704 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e41bb-71c0-48fe-acdb-948b9a3ba3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:13.090325 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e41bb-71c0-48fe-acdb-948b9a3ba3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:13.090649 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e41bb-71c0-48fe-acdb-948b9a3ba3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:13.090910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e41bb-71c0-48fe-acdb-948b9a3ba3e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:13.091541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e41bb-71c0-48fe-acdb-948b9a3ba3e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:13.093554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e41bb-71c0-48fe-acdb-948b9a3ba3e0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:13.189069 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1206/2417] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:13 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:13.193050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8c9e6-c465-4b96-9a02-879fd9274acb None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:13.204316 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8c9e6-c465-4b96-9a02-879fd9274acb None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:13.261254 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d06e85-e851-486a-a1c0-50ee253ce407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:13.261818 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d06e85-e851-486a-a1c0-50ee253ce407 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:13.262128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d06e85-e851-486a-a1c0-50ee253ce407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:13.262426 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d06e85-e851-486a-a1c0-50ee253ce407 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:13.263064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d06e85-e851-486a-a1c0-50ee253ce407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:13.265146 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d06e85-e851-486a-a1c0-50ee253ce407 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:13.466819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1212/2418] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:13 2022] POST /identity/v3/users => generated 298 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:13.471357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e41bb-71c0-48fe-acdb-948b9a3ba3e0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:13.481520 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e41bb-71c0-48fe-acdb-948b9a3ba3e0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:13.486900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db6e89-c654-4abf-b4c8-f5cd0e03f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:13.486900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db6e89-c654-4abf-b4c8-f5cd0e03f17a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:13.486900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db6e89-c654-4abf-b4c8-f5cd0e03f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:13.487213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db6e89-c654-4abf-b4c8-f5cd0e03f17a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:13.487638 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db6e89-c654-4abf-b4c8-f5cd0e03f17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:13.489207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db6e89-c654-4abf-b4c8-f5cd0e03f17a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:13.499663 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1207/2419] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:13.503761 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d06e85-e851-486a-a1c0-50ee253ce407 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:13.513803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d06e85-e851-486a-a1c0-50ee253ce407 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:13.518765 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f32f0-0916-48d7-b35a-53403d5013bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:13.519398 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f32f0-0916-48d7-b35a-53403d5013bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:13.519675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f32f0-0916-48d7-b35a-53403d5013bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:13.519943 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f32f0-0916-48d7-b35a-53403d5013bc admin admin] PATH_INFO: `/v3/projects/1a195b3a8e21423abfec0df414764874/users/406035249c9848d7a9d597c62010a690/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:13.535051 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f32f0-0916-48d7-b35a-53403d5013bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a195b3a8e21423abfec0df414764874, user_id=406035249c9848d7a9d597c62010a690, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:13.537702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f32f0-0916-48d7-b35a-53403d5013bc admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:13.593665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1213/2420] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:13 2022] PUT /identity/v3/projects/1a195b3a8e21423abfec0df414764874/users/406035249c9848d7a9d597c62010a690/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:13.598266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db6e89-c654-4abf-b4c8-f5cd0e03f17a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:13.608282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db6e89-c654-4abf-b4c8-f5cd0e03f17a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:13.670333 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1aae9-df00-4463-a831-97f9077f455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:13.671316 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1aae9-df00-4463-a831-97f9077f455a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:13.671761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1aae9-df00-4463-a831-97f9077f455a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:13.672186 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1aae9-df00-4463-a831-97f9077f455a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:13.673415 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1aae9-df00-4463-a831-97f9077f455a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:13.675819 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1aae9-df00-4463-a831-97f9077f455a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:13.686010 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1208/2421] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:13.690720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f32f0-0916-48d7-b35a-53403d5013bc admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:13.701448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f32f0-0916-48d7-b35a-53403d5013bc admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:13.709686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dda5dc-7456-4d90-9922-7a2d0dd4515b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:13.710342 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dda5dc-7456-4d90-9922-7a2d0dd4515b admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:13.710610 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dda5dc-7456-4d90-9922-7a2d0dd4515b admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:13.710872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dda5dc-7456-4d90-9922-7a2d0dd4515b admin admin] PATH_INFO: `/v3/projects/1a195b3a8e21423abfec0df414764874/users/406035249c9848d7a9d597c62010a690/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:13.712866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dda5dc-7456-4d90-9922-7a2d0dd4515b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a195b3a8e21423abfec0df414764874, user_id=406035249c9848d7a9d597c62010a690, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:13.715490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dda5dc-7456-4d90-9922-7a2d0dd4515b admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:13.727313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1214/2422] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:13 2022] PUT /identity/v3/projects/1a195b3a8e21423abfec0df414764874/users/406035249c9848d7a9d597c62010a690/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:13.738546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4219b73-aad4-4892-827f-03ccdcf8cbb1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:13.738894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4219b73-aad4-4892-827f-03ccdcf8cbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:13.739249 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4219b73-aad4-4892-827f-03ccdcf8cbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:13.767036 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c4219b73-aad4-4892-827f-03ccdcf8cbb1 None None] MFA Rules not processed for user `406035249c9848d7a9d597c62010a690`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:13.768164 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c4219b73-aad4-4892-827f-03ccdcf8cbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:13.837571 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1209/2423] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:13.848901 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dda5dc-7456-4d90-9922-7a2d0dd4515b admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:13.850726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c9dda5dc-7456-4d90-9922-7a2d0dd4515b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:13.912909 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dda5dc-7456-4d90-9922-7a2d0dd4515b admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:13.916617 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98a3fb-93f1-4ef4-9d05-1262fe65bc73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:13.917223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98a3fb-93f1-4ef4-9d05-1262fe65bc73 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:13.917539 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98a3fb-93f1-4ef4-9d05-1262fe65bc73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:13.917812 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98a3fb-93f1-4ef4-9d05-1262fe65bc73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:13.923046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:13.977675 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98a3fb-93f1-4ef4-9d05-1262fe65bc73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:13.979116 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98a3fb-93f1-4ef4-9d05-1262fe65bc73 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:13.989052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1215/2424] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:19.437462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4219b73-aad4-4892-827f-03ccdcf8cbb1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:19.446954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4219b73-aad4-4892-827f-03ccdcf8cbb1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:19.450417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cb22c-283c-441a-83b1-b72dbcc64e20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:19.451001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cb22c-283c-441a-83b1-b72dbcc64e20 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:19.451274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cb22c-283c-441a-83b1-b72dbcc64e20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:19.451539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cb22c-283c-441a-83b1-b72dbcc64e20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:19.461068 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cb22c-283c-441a-83b1-b72dbcc64e20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:19.462539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cb22c-283c-441a-83b1-b72dbcc64e20 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:19.471882 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1210/2425] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:19.904319 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98a3fb-93f1-4ef4-9d05-1262fe65bc73 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:19.905783 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-bf98a3fb-93f1-4ef4-9d05-1262fe65bc73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:19.972733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98a3fb-93f1-4ef4-9d05-1262fe65bc73 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:19.983828 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:19.984471 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:19.984779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:19.985052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] PATH_INFO: `/v3/users/7540292ad81549e9bac3551f98d3a53f` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:19.986282 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7540292ad81549e9bac3551f98d3a53f)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:19.988200 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:20.489245 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7540292ad81549e9bac3551f98d3a53f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:20.490662 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7540292ad81549e9bac3551f98d3a53f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:20.505223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7540292ad81549e9bac3551f98d3a53f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:20.505957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7540292ad81549e9bac3551f98d3a53f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:20.564319 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7540292ad81549e9bac3551f98d3a53f'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:20.577663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1216/2426] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:19 2022] DELETE /identity/v3/users/7540292ad81549e9bac3551f98d3a53f => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:20.582224 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f088e5-7d6b-4656-8545-1e6c39c7c065 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:20.582702 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f088e5-7d6b-4656-8545-1e6c39c7c065 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:20.582893 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f088e5-7d6b-4656-8545-1e6c39c7c065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:20.591150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:20.603026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f4f088e5-7d6b-4656-8545-1e6c39c7c065 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:20.604237 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f4f088e5-7d6b-4656-8545-1e6c39c7c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:20.669003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1211/2427] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:20.682781 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:20.684296 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:20.716674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:20.743667 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef23b93-db97-4c99-b476-19b116761fc1 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:20.747192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544eacd-bd56-4472-b6c5-182e77d1f658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:20.747784 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544eacd-bd56-4472-b6c5-182e77d1f658 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:20.748066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544eacd-bd56-4472-b6c5-182e77d1f658 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:20.748326 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544eacd-bd56-4472-b6c5-182e77d1f658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:20.757477 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544eacd-bd56-4472-b6c5-182e77d1f658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:20.765304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544eacd-bd56-4472-b6c5-182e77d1f658 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:20.769262 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1217/2428] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:21.224758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f088e5-7d6b-4656-8545-1e6c39c7c065 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:21.226942 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f4f088e5-7d6b-4656-8545-1e6c39c7c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:21.239871 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f088e5-7d6b-4656-8545-1e6c39c7c065 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:21.245404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9aa334-95f2-401c-ad6d-0e247e77609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:21.246030 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa334-95f2-401c-ad6d-0e247e77609a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:21.249393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa334-95f2-401c-ad6d-0e247e77609a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:21.249393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9aa334-95f2-401c-ad6d-0e247e77609a admin admin] PATH_INFO: `/v3/projects/6fa044b9399044be98de246a679d4ebf` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:21.249393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9aa334-95f2-401c-ad6d-0e247e77609a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa044b9399044be98de246a679d4ebf)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:21.250008 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9aa334-95f2-401c-ad6d-0e247e77609a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:21.400279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8d9aa334-95f2-401c-ad6d-0e247e77609a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa044b9399044be98de246a679d4ebf', 'request_id': 'req-8d9aa334-95f2-401c-ad6d-0e247e77609a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:21.525948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8d9aa334-95f2-401c-ad6d-0e247e77609a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa044b9399044be98de246a679d4ebf', 'request_id': 'req-8d9aa334-95f2-401c-ad6d-0e247e77609a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:21.533143 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8d9aa334-95f2-401c-ad6d-0e247e77609a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa044b9399044be98de246a679d4ebf', 'request_id': 'req-8d9aa334-95f2-401c-ad6d-0e247e77609a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:21.545026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8d9aa334-95f2-401c-ad6d-0e247e77609a admin admin] The token cache is being invalidate because project 6fa044b9399044be98de246a679d4ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:21.545026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8d9aa334-95f2-401c-ad6d-0e247e77609a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:21.545710 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8d9aa334-95f2-401c-ad6d-0e247e77609a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:21.547312 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1212/2429] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:21 2022] DELETE /identity/v3/projects/6fa044b9399044be98de246a679d4ebf => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:21.552299 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158763db-9505-481c-bd2a-33251fc8026b None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:21.552774 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158763db-9505-481c-bd2a-33251fc8026b None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:21.552924 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158763db-9505-481c-bd2a-33251fc8026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:21.574847 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-158763db-9505-481c-bd2a-33251fc8026b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:21.576050 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-158763db-9505-481c-bd2a-33251fc8026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:21.636649 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1218/2430] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:21.644518 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d75bcb-0706-4e52-9669-dcf37ae5aff8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:21.645037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d75bcb-0706-4e52-9669-dcf37ae5aff8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:21.645037 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d75bcb-0706-4e52-9669-dcf37ae5aff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:21.666830 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e2d75bcb-0706-4e52-9669-dcf37ae5aff8 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:21.668040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e2d75bcb-0706-4e52-9669-dcf37ae5aff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:21.676217 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1213/2431] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:21.681114 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158763db-9505-481c-bd2a-33251fc8026b None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:21.691653 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158763db-9505-481c-bd2a-33251fc8026b None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:21.696570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26135ed0-6f7a-4efe-a473-44622a169456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:21.697175 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26135ed0-6f7a-4efe-a473-44622a169456 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:21.697492 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26135ed0-6f7a-4efe-a473-44622a169456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:21.697757 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26135ed0-6f7a-4efe-a473-44622a169456 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:21.698405 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26135ed0-6f7a-4efe-a473-44622a169456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:19:21.698700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26135ed0-6f7a-4efe-a473-44622a169456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:21.700317 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26135ed0-6f7a-4efe-a473-44622a169456 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:21.712589 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1219/2432] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:19:21.716980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d75bcb-0706-4e52-9669-dcf37ae5aff8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:21.726930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d75bcb-0706-4e52-9669-dcf37ae5aff8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:21.731820 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116dd4-5849-4938-8d5b-44eb253b990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:21.732482 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116dd4-5849-4938-8d5b-44eb253b990b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:21.734343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116dd4-5849-4938-8d5b-44eb253b990b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:21.734343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116dd4-5849-4938-8d5b-44eb253b990b admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:21.734343 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99116dd4-5849-4938-8d5b-44eb253b990b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:21.735599 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99116dd4-5849-4938-8d5b-44eb253b990b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:21.847670 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1214/2433] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:21 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:21.852391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26135ed0-6f7a-4efe-a473-44622a169456 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:21.862475 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26135ed0-6f7a-4efe-a473-44622a169456 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:21.935449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ead99-6b95-453a-8370-35096ef74d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:21.936079 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ead99-6b95-453a-8370-35096ef74d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:21.936351 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ead99-6b95-453a-8370-35096ef74d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:21.936615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ead99-6b95-453a-8370-35096ef74d3c admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:21.937244 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ead99-6b95-453a-8370-35096ef74d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:21.939228 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ead99-6b95-453a-8370-35096ef74d3c admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:22.063550 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1220/2434] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:21 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:22.067821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116dd4-5849-4938-8d5b-44eb253b990b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:22.078271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116dd4-5849-4938-8d5b-44eb253b990b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:22.082726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c2e56-0b46-43bf-97ea-0f50a13d98c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:22.083316 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c2e56-0b46-43bf-97ea-0f50a13d98c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:22.083589 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c2e56-0b46-43bf-97ea-0f50a13d98c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:22.083858 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c2e56-0b46-43bf-97ea-0f50a13d98c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:22.084510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c2e56-0b46-43bf-97ea-0f50a13d98c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:22.086788 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c2e56-0b46-43bf-97ea-0f50a13d98c9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:22.097335 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1215/2435] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:22.101434 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ead99-6b95-453a-8370-35096ef74d3c admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:22.111628 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ead99-6b95-453a-8370-35096ef74d3c admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:22.116255 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ee7a4-d080-44bf-b30b-d13fd12a2d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:22.116923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ee7a4-d080-44bf-b30b-d13fd12a2d25 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:22.117204 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ee7a4-d080-44bf-b30b-d13fd12a2d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:22.117497 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ee7a4-d080-44bf-b30b-d13fd12a2d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:22.117628 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c2e56-0b46-43bf-97ea-0f50a13d98c9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:22.118140 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ee7a4-d080-44bf-b30b-d13fd12a2d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:22.119213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fa6c2e56-0b46-43bf-97ea-0f50a13d98c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:22.119766 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ee7a4-d080-44bf-b30b-d13fd12a2d25 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:22.131049 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1221/2436] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:22.133156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c2e56-0b46-43bf-97ea-0f50a13d98c9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:22.135740 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ee7a4-d080-44bf-b30b-d13fd12a2d25 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:22.138214 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:22.138839 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:22.146896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:22.146896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] PATH_INFO: `/v3/users/99c449feefd1404e8fe8122c71c5439e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:22.146896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c449feefd1404e8fe8122c71c5439e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:22.146896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:22.147270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ee7a4-d080-44bf-b30b-d13fd12a2d25 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:22.151115 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e916d19-2551-4a35-bd3f-411768c40073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:22.151803 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e916d19-2551-4a35-bd3f-411768c40073 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:22.152084 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e916d19-2551-4a35-bd3f-411768c40073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:22.152354 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e916d19-2551-4a35-bd3f-411768c40073 admin admin] PATH_INFO: `/v3/projects/d33eb16a0a6f4b5b8f56efacf7f23670/users/8578a6418a894014b9288683709303ea/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:22.168406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e916d19-2551-4a35-bd3f-411768c40073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33eb16a0a6f4b5b8f56efacf7f23670, user_id=8578a6418a894014b9288683709303ea, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:22.170977 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e916d19-2551-4a35-bd3f-411768c40073 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:22.315026 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1222/2437] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:22 2022] PUT /identity/v3/projects/d33eb16a0a6f4b5b8f56efacf7f23670/users/8578a6418a894014b9288683709303ea/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:22.326174 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658817a8-45c3-4de5-8969-ed08211348e9 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:22.326453 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658817a8-45c3-4de5-8969-ed08211348e9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:22.326720 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658817a8-45c3-4de5-8969-ed08211348e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:22.346746 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:22.354341 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-658817a8-45c3-4de5-8969-ed08211348e9 None None] MFA Rules not processed for user `8578a6418a894014b9288683709303ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:22.355552 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-658817a8-45c3-4de5-8969-ed08211348e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:22.420943 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1223/2438] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:22.432398 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658817a8-45c3-4de5-8969-ed08211348e9 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:22.433852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-658817a8-45c3-4de5-8969-ed08211348e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:22.488613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658817a8-45c3-4de5-8969-ed08211348e9 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:22.492788 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e73920-0c5a-4b10-ab6a-b13f84c6f2ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:22.494777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73920-0c5a-4b10-ab6a-b13f84c6f2ca service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:22.494777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73920-0c5a-4b10-ab6a-b13f84c6f2ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:22.494777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73920-0c5a-4b10-ab6a-b13f84c6f2ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:22.502681 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e73920-0c5a-4b10-ab6a-b13f84c6f2ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:22.503875 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:22.504099 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e73920-0c5a-4b10-ab6a-b13f84c6f2ca service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:22.506321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c449feefd1404e8fe8122c71c5439e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:22.507018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c449feefd1404e8fe8122c71c5439e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:22.513538 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1224/2439] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:22.514768 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c449feefd1404e8fe8122c71c5439e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:22.629465 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c449feefd1404e8fe8122c71c5439e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:22.643013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c449feefd1404e8fe8122c71c5439e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:22.652565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1216/2440] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:22 2022] DELETE /identity/v3/users/99c449feefd1404e8fe8122c71c5439e => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:22.653753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89d5b0-d5b2-4d40-abd1-6da24b945cde None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:22.654159 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89d5b0-d5b2-4d40-abd1-6da24b945cde None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:22.654305 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89d5b0-d5b2-4d40-abd1-6da24b945cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:22.675141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-5a89d5b0-d5b2-4d40-abd1-6da24b945cde None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:22.676408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5a89d5b0-d5b2-4d40-abd1-6da24b945cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:22.739291 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1225/2441] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:22.755402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:22.756827 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:22.817146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0fa63-6deb-463d-9612-1b85c479537d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:22.821323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1327913-3741-4f3b-947b-fa5f276f51a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:22.821978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1327913-3741-4f3b-947b-fa5f276f51a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:22.822305 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1327913-3741-4f3b-947b-fa5f276f51a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:22.822583 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1327913-3741-4f3b-947b-fa5f276f51a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:22.831677 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1327913-3741-4f3b-947b-fa5f276f51a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:22.833153 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1327913-3741-4f3b-947b-fa5f276f51a2 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:22.843445 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1217/2442] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:23.282462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89d5b0-d5b2-4d40-abd1-6da24b945cde None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:23.284092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5a89d5b0-d5b2-4d40-abd1-6da24b945cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:23.301036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89d5b0-d5b2-4d40-abd1-6da24b945cde None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:23.309850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:23.310561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:23.310964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:23.311300 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] PATH_INFO: `/v3/projects/dd98aab47b7546f492d7f5489f2bae50` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:23.312768 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd98aab47b7546f492d7f5489f2bae50)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:23.315403 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:23.468773 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:23.475760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd98aab47b7546f492d7f5489f2bae50', 'request_id': 'req-5d12ee16-fe87-47c6-9693-2ce0afa145df'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:23.577716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd98aab47b7546f492d7f5489f2bae50', 'request_id': 'req-5d12ee16-fe87-47c6-9693-2ce0afa145df'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:23.587437 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd98aab47b7546f492d7f5489f2bae50', 'request_id': 'req-5d12ee16-fe87-47c6-9693-2ce0afa145df'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:23.597591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] The token cache is being invalidate because project dd98aab47b7546f492d7f5489f2bae50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:23.597876 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:23.598529 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:23.600003 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1226/2443] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:23 2022] DELETE /identity/v3/projects/dd98aab47b7546f492d7f5489f2bae50 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:23.604206 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1327913-3741-4f3b-947b-fa5f276f51a2 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:23.613836 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1327913-3741-4f3b-947b-fa5f276f51a2 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:23.671892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a283c-a9e9-4103-bc9f-7ba97fce220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:23.672551 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a283c-a9e9-4103-bc9f-7ba97fce220e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:23.672989 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a283c-a9e9-4103-bc9f-7ba97fce220e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:23.673271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a283c-a9e9-4103-bc9f-7ba97fce220e admin admin] PATH_INFO: `/v3/users/7f3ebdaf93ae4cf9ad4dfd8e13c9f149` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:23.674421 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a283c-a9e9-4103-bc9f-7ba97fce220e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3ebdaf93ae4cf9ad4dfd8e13c9f149)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:23.676312 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a283c-a9e9-4103-bc9f-7ba97fce220e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:23.882703 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b37a283c-a9e9-4103-bc9f-7ba97fce220e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3ebdaf93ae4cf9ad4dfd8e13c9f149'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:23.883349 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b37a283c-a9e9-4103-bc9f-7ba97fce220e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3ebdaf93ae4cf9ad4dfd8e13c9f149'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:23.891088 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b37a283c-a9e9-4103-bc9f-7ba97fce220e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3ebdaf93ae4cf9ad4dfd8e13c9f149'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:23.971198 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b37a283c-a9e9-4103-bc9f-7ba97fce220e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3ebdaf93ae4cf9ad4dfd8e13c9f149'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:23.973438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:23.987066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b37a283c-a9e9-4103-bc9f-7ba97fce220e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3ebdaf93ae4cf9ad4dfd8e13c9f149'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:23.993755 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1218/2444] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:23 2022] DELETE /identity/v3/users/7f3ebdaf93ae4cf9ad4dfd8e13c9f149 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:24.493951 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:24.495569 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:24.510401 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12ee16-fe87-47c6-9693-2ce0afa145df admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:24.568819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ab421-fecb-421b-9ec2-1a8b14778812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:24.569549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ab421-fecb-421b-9ec2-1a8b14778812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:24.569821 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ab421-fecb-421b-9ec2-1a8b14778812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:24.570110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ab421-fecb-421b-9ec2-1a8b14778812 admin admin] PATH_INFO: `/v3/projects/1627d90d31fd417f91b8db99d7cc0104` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:24.571742 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ab421-fecb-421b-9ec2-1a8b14778812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1627d90d31fd417f91b8db99d7cc0104)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:24.573807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ab421-fecb-421b-9ec2-1a8b14778812 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:24.705863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-620ab421-fecb-421b-9ec2-1a8b14778812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1627d90d31fd417f91b8db99d7cc0104', 'request_id': 'req-620ab421-fecb-421b-9ec2-1a8b14778812'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:24.799731 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-620ab421-fecb-421b-9ec2-1a8b14778812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1627d90d31fd417f91b8db99d7cc0104', 'request_id': 'req-620ab421-fecb-421b-9ec2-1a8b14778812'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:24.807622 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-620ab421-fecb-421b-9ec2-1a8b14778812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1627d90d31fd417f91b8db99d7cc0104', 'request_id': 'req-620ab421-fecb-421b-9ec2-1a8b14778812'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:24.818996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-620ab421-fecb-421b-9ec2-1a8b14778812 admin admin] The token cache is being invalidate because project 1627d90d31fd417f91b8db99d7cc0104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:24.819289 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-620ab421-fecb-421b-9ec2-1a8b14778812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:24.819936 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-620ab421-fecb-421b-9ec2-1a8b14778812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:24.822332 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1227/2445] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:24 2022] DELETE /identity/v3/projects/1627d90d31fd417f91b8db99d7cc0104 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:24.828445 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee0d29-869a-4a66-a5f0-5f26831ddf80 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:24.829070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee0d29-869a-4a66-a5f0-5f26831ddf80 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:24.829070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee0d29-869a-4a66-a5f0-5f26831ddf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:24.850200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0fee0d29-869a-4a66-a5f0-5f26831ddf80 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:24.851401 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0fee0d29-869a-4a66-a5f0-5f26831ddf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:24.911412 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1219/2446] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:24.920929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae851-1fb7-4852-9a37-6dccb6027e94 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:24.921220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae851-1fb7-4852-9a37-6dccb6027e94 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:24.921998 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ae851-1fb7-4852-9a37-6dccb6027e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:24.948480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-739ae851-1fb7-4852-9a37-6dccb6027e94 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:24.949801 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-739ae851-1fb7-4852-9a37-6dccb6027e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:24.957935 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1228/2447] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:24.962329 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee0d29-869a-4a66-a5f0-5f26831ddf80 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:24.972018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee0d29-869a-4a66-a5f0-5f26831ddf80 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:24.978118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8344b55-2304-4845-b201-249c8ccfd0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:24.978804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8344b55-2304-4845-b201-249c8ccfd0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:24.979138 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8344b55-2304-4845-b201-249c8ccfd0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:24.979500 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8344b55-2304-4845-b201-249c8ccfd0b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:24.980161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8344b55-2304-4845-b201-249c8ccfd0b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:19:24.980481 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8344b55-2304-4845-b201-249c8ccfd0b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:24.982392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8344b55-2304-4845-b201-249c8ccfd0b4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:24.995393 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1220/2448] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:19:24.999767 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae851-1fb7-4852-9a37-6dccb6027e94 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:25.009613 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ae851-1fb7-4852-9a37-6dccb6027e94 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:25.014390 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d3e8f-74fd-4194-8486-ac21f2b413e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:25.014986 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d3e8f-74fd-4194-8486-ac21f2b413e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:25.015255 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d3e8f-74fd-4194-8486-ac21f2b413e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:25.015518 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d3e8f-74fd-4194-8486-ac21f2b413e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:25.016167 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d3e8f-74fd-4194-8486-ac21f2b413e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:25.018076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d3e8f-74fd-4194-8486-ac21f2b413e4 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:25.142794 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1229/2449] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:24 2022] POST /identity/v3/projects => generated 393 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:25.146963 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8344b55-2304-4845-b201-249c8ccfd0b4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:25.157070 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8344b55-2304-4845-b201-249c8ccfd0b4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:25.221141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad3ee8-7958-4099-aa2c-fecda6873471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:25.221141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad3ee8-7958-4099-aa2c-fecda6873471 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:25.221141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad3ee8-7958-4099-aa2c-fecda6873471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:25.221141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad3ee8-7958-4099-aa2c-fecda6873471 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:25.221582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad3ee8-7958-4099-aa2c-fecda6873471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:25.221793 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad3ee8-7958-4099-aa2c-fecda6873471 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:25.335540 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1221/2450] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:25 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:25.337724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d3e8f-74fd-4194-8486-ac21f2b413e4 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:25.348323 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d3e8f-74fd-4194-8486-ac21f2b413e4 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:25.354097 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208717-f0bd-4153-ac2b-c1dc01d99025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:25.354691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208717-f0bd-4153-ac2b-c1dc01d99025 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:25.354989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208717-f0bd-4153-ac2b-c1dc01d99025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:25.355312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208717-f0bd-4153-ac2b-c1dc01d99025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:25.355993 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208717-f0bd-4153-ac2b-c1dc01d99025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:25.357871 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208717-f0bd-4153-ac2b-c1dc01d99025 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:25.368516 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1230/2451] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:25.372691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad3ee8-7958-4099-aa2c-fecda6873471 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:25.382821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad3ee8-7958-4099-aa2c-fecda6873471 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:25.387818 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c4f05-850d-43ee-bd14-fc86be5f51b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:25.393174 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c4f05-850d-43ee-bd14-fc86be5f51b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:25.393174 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c4f05-850d-43ee-bd14-fc86be5f51b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:25.393174 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c4f05-850d-43ee-bd14-fc86be5f51b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:25.393174 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c4f05-850d-43ee-bd14-fc86be5f51b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:25.393174 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c4f05-850d-43ee-bd14-fc86be5f51b5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:25.402171 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1222/2452] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:25.406408 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208717-f0bd-4153-ac2b-c1dc01d99025 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:25.417717 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208717-f0bd-4153-ac2b-c1dc01d99025 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:25.422382 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4ac6c-6b97-48ac-9c58-c559169d9437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:25.426582 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4ac6c-6b97-48ac-9c58-c559169d9437 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:25.426582 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4ac6c-6b97-48ac-9c58-c559169d9437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:25.426582 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4ac6c-6b97-48ac-9c58-c559169d9437 admin admin] PATH_INFO: `/v3/projects/60cae8aa341e458f8eac18ef26bdcceb/users/60cc1db21e9c48b4b1ce13d4c263c8e5/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:25.438952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4ac6c-6b97-48ac-9c58-c559169d9437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cae8aa341e458f8eac18ef26bdcceb, user_id=60cc1db21e9c48b4b1ce13d4c263c8e5, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:25.441929 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4ac6c-6b97-48ac-9c58-c559169d9437 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:25.444241 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:25.537844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1231/2453] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:25 2022] PUT /identity/v3/projects/60cae8aa341e458f8eac18ef26bdcceb/users/60cc1db21e9c48b4b1ce13d4c263c8e5/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:25.548509 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ece3c2-b378-48e2-980d-2c2e90cc5aa1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:25.548793 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ece3c2-b378-48e2-980d-2c2e90cc5aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:25.549076 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ece3c2-b378-48e2-980d-2c2e90cc5aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:25.576810 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-79ece3c2-b378-48e2-980d-2c2e90cc5aa1 None None] MFA Rules not processed for user `60cc1db21e9c48b4b1ce13d4c263c8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:25.578075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-79ece3c2-b378-48e2-980d-2c2e90cc5aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:25.616056 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:25.642475 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1223/2454] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:25.647171 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4ac6c-6b97-48ac-9c58-c559169d9437 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:25.711424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4ac6c-6b97-48ac-9c58-c559169d9437 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:25.717706 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449124b-8e8c-4b63-9644-2b4104938eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:25.719888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449124b-8e8c-4b63-9644-2b4104938eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:25.719888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449124b-8e8c-4b63-9644-2b4104938eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:25.719888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449124b-8e8c-4b63-9644-2b4104938eb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:25.719888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449124b-8e8c-4b63-9644-2b4104938eb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:25.721363 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449124b-8e8c-4b63-9644-2b4104938eb8 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:25.789635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1232/2455] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:25 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:25.793694 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ece3c2-b378-48e2-980d-2c2e90cc5aa1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:25.804792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ece3c2-b378-48e2-980d-2c2e90cc5aa1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:25.863471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc346f42-03ae-49a6-9636-9c7354793a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:25.864123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc346f42-03ae-49a6-9636-9c7354793a24 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:25.864327 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc346f42-03ae-49a6-9636-9c7354793a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:25.864605 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc346f42-03ae-49a6-9636-9c7354793a24 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:25.865236 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc346f42-03ae-49a6-9636-9c7354793a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:25.867156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc346f42-03ae-49a6-9636-9c7354793a24 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:25.973171 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449124b-8e8c-4b63-9644-2b4104938eb8 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:25.975004 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-0449124b-8e8c-4b63-9644-2b4104938eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:25.988480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449124b-8e8c-4b63-9644-2b4104938eb8 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:25.989587 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1224/2456] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:25 2022] POST /identity/v3/users => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:25.993443 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc346f42-03ae-49a6-9636-9c7354793a24 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:25.993852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f416-6756-4770-a24d-6c7f2bd894c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:25.995071 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f416-6756-4770-a24d-6c7f2bd894c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:25.995517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f416-6756-4770-a24d-6c7f2bd894c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:25.995805 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f416-6756-4770-a24d-6c7f2bd894c0 admin admin] PATH_INFO: `/v3/users/bf1dcba45d174febb788a6eaaaf0d329` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:25.996968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2f416-6756-4770-a24d-6c7f2bd894c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1dcba45d174febb788a6eaaaf0d329)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:25.999263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2f416-6756-4770-a24d-6c7f2bd894c0 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:26.004171 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc346f42-03ae-49a6-9636-9c7354793a24 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:26.008993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b7beb-bfad-4c58-b036-a6f236a76e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:26.009640 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7beb-bfad-4c58-b036-a6f236a76e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:26.010018 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7beb-bfad-4c58-b036-a6f236a76e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:26.010925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7beb-bfad-4c58-b036-a6f236a76e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:26.011574 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b7beb-bfad-4c58-b036-a6f236a76e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:26.013422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b7beb-bfad-4c58-b036-a6f236a76e80 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:26.023369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1225/2457] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:26.027906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b7beb-bfad-4c58-b036-a6f236a76e80 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:26.037584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b7beb-bfad-4c58-b036-a6f236a76e80 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:26.042352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fa0e3-ec63-4b9b-af83-664c82db2541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:26.042968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fa0e3-ec63-4b9b-af83-664c82db2541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:26.043244 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fa0e3-ec63-4b9b-af83-664c82db2541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:26.043515 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fa0e3-ec63-4b9b-af83-664c82db2541 admin admin] PATH_INFO: `/v3/projects/fe02b4eb8bc14a20b6df1edc598928ca/users/38383294e7914464b8268a98a0091de2/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:26.059135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fa0e3-ec63-4b9b-af83-664c82db2541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe02b4eb8bc14a20b6df1edc598928ca, user_id=38383294e7914464b8268a98a0091de2, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:26.061831 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fa0e3-ec63-4b9b-af83-664c82db2541 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:26.138191 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1226/2458] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:26 2022] PUT /identity/v3/projects/fe02b4eb8bc14a20b6df1edc598928ca/users/38383294e7914464b8268a98a0091de2/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:26.142390 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fa0e3-ec63-4b9b-af83-664c82db2541 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:26.183981 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c0d2f416-6756-4770-a24d-6c7f2bd894c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1dcba45d174febb788a6eaaaf0d329'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:26.184642 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c0d2f416-6756-4770-a24d-6c7f2bd894c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1dcba45d174febb788a6eaaaf0d329'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:26.198962 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c0d2f416-6756-4770-a24d-6c7f2bd894c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1dcba45d174febb788a6eaaaf0d329'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:26.199738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c0d2f416-6756-4770-a24d-6c7f2bd894c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1dcba45d174febb788a6eaaaf0d329'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:26.221057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fa0e3-ec63-4b9b-af83-664c82db2541 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:26.225881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f3365-fa80-480a-8356-550c47ec85c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:26.226478 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f3365-fa80-480a-8356-550c47ec85c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:26.226752 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f3365-fa80-480a-8356-550c47ec85c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:26.227024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f3365-fa80-480a-8356-550c47ec85c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:26.227659 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f3365-fa80-480a-8356-550c47ec85c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:26.229411 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f3365-fa80-480a-8356-550c47ec85c1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:26.239722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1227/2459] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:26.245099 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f3365-fa80-480a-8356-550c47ec85c1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:26.246823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a82f3365-fa80-480a-8356-550c47ec85c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:26.261044 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f3365-fa80-480a-8356-550c47ec85c1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:26.265780 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576fc14-cf47-47ed-8d5d-3422b8ef09f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:26.266422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576fc14-cf47-47ed-8d5d-3422b8ef09f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:26.266700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576fc14-cf47-47ed-8d5d-3422b8ef09f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:26.266970 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576fc14-cf47-47ed-8d5d-3422b8ef09f4 admin admin] PATH_INFO: `/v3/projects/fe02b4eb8bc14a20b6df1edc598928ca/users/38383294e7914464b8268a98a0091de2/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:26.268862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576fc14-cf47-47ed-8d5d-3422b8ef09f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe02b4eb8bc14a20b6df1edc598928ca, user_id=38383294e7914464b8268a98a0091de2, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:26.271546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576fc14-cf47-47ed-8d5d-3422b8ef09f4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:26.273163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-c0d2f416-6756-4770-a24d-6c7f2bd894c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1dcba45d174febb788a6eaaaf0d329'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:26.283905 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1228/2460] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:26 2022] PUT /identity/v3/projects/fe02b4eb8bc14a20b6df1edc598928ca/users/38383294e7914464b8268a98a0091de2/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:26.288531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1233/2461] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:25 2022] DELETE /identity/v3/users/bf1dcba45d174febb788a6eaaaf0d329 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:26.294075 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0171-929e-48dd-bd4e-9b6e000500a9 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:26.294215 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cf76d-1333-4f80-83b9-5061101879d5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:26.294395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0171-929e-48dd-bd4e-9b6e000500a9 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:26.294516 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cf76d-1333-4f80-83b9-5061101879d5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:26.294690 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cf76d-1333-4f80-83b9-5061101879d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:26.294807 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0171-929e-48dd-bd4e-9b6e000500a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:26.315536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9a1cf76d-1333-4f80-83b9-5061101879d5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:26.316829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9a1cf76d-1333-4f80-83b9-5061101879d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:26.328020 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-670f0171-929e-48dd-bd4e-9b6e000500a9 None None] MFA Rules not processed for user `38383294e7914464b8268a98a0091de2`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:26.328595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:26.330279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-670f0171-929e-48dd-bd4e-9b6e000500a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:26.375280 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:26.387375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1229/2462] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:26.397222 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cf76d-1333-4f80-83b9-5061101879d5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:26.398616 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9a1cf76d-1333-4f80-83b9-5061101879d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:26.407961 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1234/2463] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:26.423025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f0171-929e-48dd-bd4e-9b6e000500a9 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:26.424393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-670f0171-929e-48dd-bd4e-9b6e000500a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:26.458896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cf76d-1333-4f80-83b9-5061101879d5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:26.462719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c74e17-8746-4bd6-8860-3ddbad2cb7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:26.463917 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c74e17-8746-4bd6-8860-3ddbad2cb7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:26.464187 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c74e17-8746-4bd6-8860-3ddbad2cb7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:26.464452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c74e17-8746-4bd6-8860-3ddbad2cb7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:26.473824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c74e17-8746-4bd6-8860-3ddbad2cb7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:26.475178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c74e17-8746-4bd6-8860-3ddbad2cb7d0 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:26.484947 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f0171-929e-48dd-bd4e-9b6e000500a9 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:26.486040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1230/2464] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:26.489144 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ca4f5-9cf5-4c38-9d83-16442f3d02fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:26.490463 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ca4f5-9cf5-4c38-9d83-16442f3d02fc service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:26.490748 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ca4f5-9cf5-4c38-9d83-16442f3d02fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:26.491015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ca4f5-9cf5-4c38-9d83-16442f3d02fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:26.501187 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ca4f5-9cf5-4c38-9d83-16442f3d02fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:26.503143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ca4f5-9cf5-4c38-9d83-16442f3d02fc service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:26.513996 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1235/2465] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:26 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:26.561339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c74e17-8746-4bd6-8860-3ddbad2cb7d0 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:26.570966 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c74e17-8746-4bd6-8860-3ddbad2cb7d0 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:26.576039 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9086e-b99f-4856-9894-9dcd06733bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:26.576642 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9086e-b99f-4856-9894-9dcd06733bcd service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:26.576926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9086e-b99f-4856-9894-9dcd06733bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:26.577372 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9086e-b99f-4856-9894-9dcd06733bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:26.579168 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dfc9086e-b99f-4856-9894-9dcd06733bcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:26.640781 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9086e-b99f-4856-9894-9dcd06733bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:26.642237 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9086e-b99f-4856-9894-9dcd06733bcd service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:26.651572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1231/2466] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:26.911625 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ca4f5-9cf5-4c38-9d83-16442f3d02fc service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:26.913009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-cb2ca4f5-9cf5-4c38-9d83-16442f3d02fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:26.943495 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ca4f5-9cf5-4c38-9d83-16442f3d02fc service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:26.950829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:26.950829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:26.950829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:26.950829 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] PATH_INFO: `/v3/projects/502508e000df4983b5ef2bb49ebf58a0` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:26.951584 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502508e000df4983b5ef2bb49ebf58a0)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:26.953554 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:27.109123 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502508e000df4983b5ef2bb49ebf58a0', 'request_id': 'req-3043d2ae-7ed4-44a1-838c-e5a070d190a5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:27.177133 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502508e000df4983b5ef2bb49ebf58a0', 'request_id': 'req-3043d2ae-7ed4-44a1-838c-e5a070d190a5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:27.185831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502508e000df4983b5ef2bb49ebf58a0', 'request_id': 'req-3043d2ae-7ed4-44a1-838c-e5a070d190a5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:27.195664 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] The token cache is being invalidate because project 502508e000df4983b5ef2bb49ebf58a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:27.195953 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:27.196626 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:27.198786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1236/2467] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:26 2022] DELETE /identity/v3/projects/502508e000df4983b5ef2bb49ebf58a0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:27.203001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9086e-b99f-4856-9894-9dcd06733bcd service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:27.214211 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9086e-b99f-4856-9894-9dcd06733bcd service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:27.265233 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:27.271296 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e43599-d520-4452-81d2-f99c9dba4b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:27.274582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43599-d520-4452-81d2-f99c9dba4b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:27.274582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43599-d520-4452-81d2-f99c9dba4b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:27.274582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e43599-d520-4452-81d2-f99c9dba4b46 admin admin] PATH_INFO: `/v3/users/406035249c9848d7a9d597c62010a690` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:27.274582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e43599-d520-4452-81d2-f99c9dba4b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=406035249c9848d7a9d597c62010a690)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:27.276200 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e43599-d520-4452-81d2-f99c9dba4b46 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:27.538700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e1e43599-d520-4452-81d2-f99c9dba4b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406035249c9848d7a9d597c62010a690'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:27.539424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e1e43599-d520-4452-81d2-f99c9dba4b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406035249c9848d7a9d597c62010a690'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:27.551509 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e1e43599-d520-4452-81d2-f99c9dba4b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406035249c9848d7a9d597c62010a690'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:27.621693 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e1e43599-d520-4452-81d2-f99c9dba4b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406035249c9848d7a9d597c62010a690'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:27.635831 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e1e43599-d520-4452-81d2-f99c9dba4b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406035249c9848d7a9d597c62010a690'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:27.641919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1232/2468] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:27 2022] DELETE /identity/v3/users/406035249c9848d7a9d597c62010a690 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:28.086523 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:28.090121 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:28.105411 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043d2ae-7ed4-44a1-838c-e5a070d190a5 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:28.164141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:28.164776 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:28.165053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:28.165349 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4 admin admin] PATH_INFO: `/v3/projects/1a195b3a8e21423abfec0df414764874` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:28.166619 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a195b3a8e21423abfec0df414764874)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:28.168676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:28.171203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:28.286605 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a195b3a8e21423abfec0df414764874', 'request_id': 'req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:28.406077 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a195b3a8e21423abfec0df414764874', 'request_id': 'req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:28.413341 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a195b3a8e21423abfec0df414764874', 'request_id': 'req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:28.425017 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4 admin admin] The token cache is being invalidate because project 1a195b3a8e21423abfec0df414764874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:28.425416 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:28.426126 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-ea644415-fc8e-4af0-9c28-4a8062c1d4f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:28.427615 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1237/2469] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:28 2022] DELETE /identity/v3/projects/1a195b3a8e21423abfec0df414764874 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:28.434157 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7db43f-ca6e-43e3-8c9c-a4656ff0e638 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:28.434669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7db43f-ca6e-43e3-8c9c-a4656ff0e638 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:28.434669 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7db43f-ca6e-43e3-8c9c-a4656ff0e638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:28.455213 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-da7db43f-ca6e-43e3-8c9c-a4656ff0e638 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:28.456557 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-da7db43f-ca6e-43e3-8c9c-a4656ff0e638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:28.516709 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1233/2470] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:28.524994 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a77ee-a845-4a7c-bcbf-195dc355eeb8 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:28.525274 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a77ee-a845-4a7c-bcbf-195dc355eeb8 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:28.526086 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a77ee-a845-4a7c-bcbf-195dc355eeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:28.553450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-aa7a77ee-a845-4a7c-bcbf-195dc355eeb8 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:28.553450 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-aa7a77ee-a845-4a7c-bcbf-195dc355eeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:28.558815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1238/2471] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:28.561474 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7db43f-ca6e-43e3-8c9c-a4656ff0e638 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:28.572437 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7db43f-ca6e-43e3-8c9c-a4656ff0e638 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:28.577611 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc75ea-d3fb-44fa-b570-4f3b26a855d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:28.584218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc75ea-d3fb-44fa-b570-4f3b26a855d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:28.584218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc75ea-d3fb-44fa-b570-4f3b26a855d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:28.584218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc75ea-d3fb-44fa-b570-4f3b26a855d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:28.584218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc75ea-d3fb-44fa-b570-4f3b26a855d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:19:28.584218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc75ea-d3fb-44fa-b570-4f3b26a855d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:28.584218 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc75ea-d3fb-44fa-b570-4f3b26a855d0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:28.595195 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1234/2472] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:19:28.602234 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a77ee-a845-4a7c-bcbf-195dc355eeb8 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:28.613971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a77ee-a845-4a7c-bcbf-195dc355eeb8 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:28.620116 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad97af-636b-4752-b601-83bf9b1e49d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:28.620721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad97af-636b-4752-b601-83bf9b1e49d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:28.620995 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad97af-636b-4752-b601-83bf9b1e49d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:28.621255 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad97af-636b-4752-b601-83bf9b1e49d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:28.622021 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad97af-636b-4752-b601-83bf9b1e49d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:28.624361 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad97af-636b-4752-b601-83bf9b1e49d7 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:28.727191 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1239/2473] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:28 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:28.735078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc75ea-d3fb-44fa-b570-4f3b26a855d0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:28.745713 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc75ea-d3fb-44fa-b570-4f3b26a855d0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:28.803931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17aef0-d0ae-45a3-8eb8-718b777e2a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:28.804584 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17aef0-d0ae-45a3-8eb8-718b777e2a39 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:28.804859 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17aef0-d0ae-45a3-8eb8-718b777e2a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:28.805129 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17aef0-d0ae-45a3-8eb8-718b777e2a39 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:28.806149 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17aef0-d0ae-45a3-8eb8-718b777e2a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:28.808450 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17aef0-d0ae-45a3-8eb8-718b777e2a39 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:28.818746 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:28.965012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1235/2474] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:28 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:28.970150 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad97af-636b-4752-b601-83bf9b1e49d7 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:28.985668 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad97af-636b-4752-b601-83bf9b1e49d7 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:28.990451 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff17f9-ec76-41de-82be-19449e9d814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:28.996845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff17f9-ec76-41de-82be-19449e9d814b admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:28.996845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff17f9-ec76-41de-82be-19449e9d814b admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:28.996845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff17f9-ec76-41de-82be-19449e9d814b admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:28.996845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff17f9-ec76-41de-82be-19449e9d814b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:28.996845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff17f9-ec76-41de-82be-19449e9d814b admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:29.006679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1240/2475] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:29.011796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17aef0-d0ae-45a3-8eb8-718b777e2a39 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:29.022901 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17aef0-d0ae-45a3-8eb8-718b777e2a39 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:29.027740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c365e-52cf-4b80-9616-c730e3889354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:29.028339 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c365e-52cf-4b80-9616-c730e3889354 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:29.028613 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c365e-52cf-4b80-9616-c730e3889354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:29.028922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c365e-52cf-4b80-9616-c730e3889354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:29.029542 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c365e-52cf-4b80-9616-c730e3889354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:29.031110 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c365e-52cf-4b80-9616-c730e3889354 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:29.043562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1236/2476] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:29.051322 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff17f9-ec76-41de-82be-19449e9d814b admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:29.063934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff17f9-ec76-41de-82be-19449e9d814b admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:29.068972 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e7114-58a3-466d-872a-b5c0e2eb91a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:29.069687 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7114-58a3-466d-872a-b5c0e2eb91a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:29.070097 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7114-58a3-466d-872a-b5c0e2eb91a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:29.070398 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7114-58a3-466d-872a-b5c0e2eb91a9 admin admin] PATH_INFO: `/v3/projects/8274a91bf4054defa3b4f7c869c915b6/users/5ebd1997b8304b2dab35071332ad32d6/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:29.089407 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e7114-58a3-466d-872a-b5c0e2eb91a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8274a91bf4054defa3b4f7c869c915b6, user_id=5ebd1997b8304b2dab35071332ad32d6, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:29.092085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e7114-58a3-466d-872a-b5c0e2eb91a9 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:29.190979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1241/2477] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:29 2022] PUT /identity/v3/projects/8274a91bf4054defa3b4f7c869c915b6/users/5ebd1997b8304b2dab35071332ad32d6/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:29.206692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a858e3f-ce00-4c3e-85f2-33afb01f7689 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:29.206980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a858e3f-ce00-4c3e-85f2-33afb01f7689 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:29.207258 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a858e3f-ce00-4c3e-85f2-33afb01f7689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:29.235542 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1a858e3f-ce00-4c3e-85f2-33afb01f7689 None None] MFA Rules not processed for user `5ebd1997b8304b2dab35071332ad32d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:29.236824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1a858e3f-ce00-4c3e-85f2-33afb01f7689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:29.315127 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1237/2478] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:29.391005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e7114-58a3-466d-872a-b5c0e2eb91a9 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:29.392721 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-fd1e7114-58a3-466d-872a-b5c0e2eb91a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:29.458457 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e7114-58a3-466d-872a-b5c0e2eb91a9 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:29.462159 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90606c94-9237-4250-a335-f97f3c2771b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:29.462756 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90606c94-9237-4250-a335-f97f3c2771b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:29.463678 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90606c94-9237-4250-a335-f97f3c2771b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:29.464078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90606c94-9237-4250-a335-f97f3c2771b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:29.472470 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90606c94-9237-4250-a335-f97f3c2771b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:29.473923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90606c94-9237-4250-a335-f97f3c2771b7 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:29.482566 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1242/2479] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:29.501987 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a858e3f-ce00-4c3e-85f2-33afb01f7689 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:29.568967 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a858e3f-ce00-4c3e-85f2-33afb01f7689 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:29.574304 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:29.574948 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:29.575212 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:29.575483 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] PATH_INFO: `/v3/users/5ebd1997b8304b2dab35071332ad32d6` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:29.576618 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ebd1997b8304b2dab35071332ad32d6)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:29.578569 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:29.801931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ebd1997b8304b2dab35071332ad32d6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:29.802575 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ebd1997b8304b2dab35071332ad32d6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:29.810531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ebd1997b8304b2dab35071332ad32d6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:29.880579 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ebd1997b8304b2dab35071332ad32d6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:29.887402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:29.892013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ebd1997b8304b2dab35071332ad32d6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:29.898125 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1238/2480] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:29 2022] DELETE /identity/v3/users/5ebd1997b8304b2dab35071332ad32d6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:29.902663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45975ef-c32a-467e-aa7a-c0b4f6a286c1 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:29.902973 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45975ef-c32a-467e-aa7a-c0b4f6a286c1 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:29.903271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45975ef-c32a-467e-aa7a-c0b4f6a286c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:29.923305 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-c45975ef-c32a-467e-aa7a-c0b4f6a286c1 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:29.924682 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c45975ef-c32a-467e-aa7a-c0b4f6a286c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:29.958174 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:29.997046 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1243/2481] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:30.006837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:30.008371 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:30.070723 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb28eae-792c-46c8-ad46-615cb8a98ad1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:30.075001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a86a40-721e-4617-bdbb-025b115dc48b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:30.075602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a86a40-721e-4617-bdbb-025b115dc48b service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:30.076003 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a86a40-721e-4617-bdbb-025b115dc48b service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:30.076278 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a86a40-721e-4617-bdbb-025b115dc48b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:30.086636 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a86a40-721e-4617-bdbb-025b115dc48b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:30.088220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a86a40-721e-4617-bdbb-025b115dc48b service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:30.099111 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1239/2482] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:30.567466 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45975ef-c32a-467e-aa7a-c0b4f6a286c1 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:30.569182 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-c45975ef-c32a-467e-aa7a-c0b4f6a286c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:30.583137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45975ef-c32a-467e-aa7a-c0b4f6a286c1 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:30.588292 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:30.589096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:30.589425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:30.589691 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300 admin admin] PATH_INFO: `/v3/projects/8274a91bf4054defa3b4f7c869c915b6` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:30.590874 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8274a91bf4054defa3b4f7c869c915b6)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:30.592982 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:30.697187 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8274a91bf4054defa3b4f7c869c915b6', 'request_id': 'req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:30.815622 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8274a91bf4054defa3b4f7c869c915b6', 'request_id': 'req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:30.823958 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8274a91bf4054defa3b4f7c869c915b6', 'request_id': 'req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:30.835159 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300 admin admin] The token cache is being invalidate because project 8274a91bf4054defa3b4f7c869c915b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:30.835448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:30.836110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-21bc88ab-2b3b-4e6a-a8f5-90ead0e0d300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:30.837718 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1244/2483] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:30 2022] DELETE /identity/v3/projects/8274a91bf4054defa3b4f7c869c915b6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:30.842718 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394790d3-ec5d-427a-a05a-f7176d380f72 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:30.843178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394790d3-ec5d-427a-a05a-f7176d380f72 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:30.843287 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394790d3-ec5d-427a-a05a-f7176d380f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:30.865227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-394790d3-ec5d-427a-a05a-f7176d380f72 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:30.866565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-394790d3-ec5d-427a-a05a-f7176d380f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:30.927010 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1240/2484] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:30.992287 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b06636-a615-44d8-9d9f-e5fb766d1eb5 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:30.992592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b06636-a615-44d8-9d9f-e5fb766d1eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:30.992867 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b06636-a615-44d8-9d9f-e5fb766d1eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:31.013833 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d4b06636-a615-44d8-9d9f-e5fb766d1eb5 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:31.015070 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d4b06636-a615-44d8-9d9f-e5fb766d1eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:31.023014 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1245/2485] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:31.027250 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394790d3-ec5d-427a-a05a-f7176d380f72 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:31.036793 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394790d3-ec5d-427a-a05a-f7176d380f72 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:31.041938 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483225d-7a02-4ae2-9e22-b498ed39247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:31.042515 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483225d-7a02-4ae2-9e22-b498ed39247a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:31.042787 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483225d-7a02-4ae2-9e22-b498ed39247a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:31.043074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483225d-7a02-4ae2-9e22-b498ed39247a admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:31.043723 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483225d-7a02-4ae2-9e22-b498ed39247a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:19:31.044017 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483225d-7a02-4ae2-9e22-b498ed39247a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:31.045717 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483225d-7a02-4ae2-9e22-b498ed39247a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:31.058526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1241/2486] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:19:31.062817 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b06636-a615-44d8-9d9f-e5fb766d1eb5 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:31.072079 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b06636-a615-44d8-9d9f-e5fb766d1eb5 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:31.076852 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6576a25-ba3b-4bc6-890d-9260f6ca3579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:31.077859 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6576a25-ba3b-4bc6-890d-9260f6ca3579 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:31.077859 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6576a25-ba3b-4bc6-890d-9260f6ca3579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:31.078080 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6576a25-ba3b-4bc6-890d-9260f6ca3579 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:31.078679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6576a25-ba3b-4bc6-890d-9260f6ca3579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:31.080607 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6576a25-ba3b-4bc6-890d-9260f6ca3579 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:31.217959 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1246/2487] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:31 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:31.221982 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483225d-7a02-4ae2-9e22-b498ed39247a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:31.232995 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483225d-7a02-4ae2-9e22-b498ed39247a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:31.294043 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e129ea6-b650-4ca0-897d-100c6d0db422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:31.294654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e129ea6-b650-4ca0-897d-100c6d0db422 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:31.294933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e129ea6-b650-4ca0-897d-100c6d0db422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:31.295193 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e129ea6-b650-4ca0-897d-100c6d0db422 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:31.295826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e129ea6-b650-4ca0-897d-100c6d0db422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:31.297938 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e129ea6-b650-4ca0-897d-100c6d0db422 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:31.400475 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1242/2488] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:31 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:31.404896 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6576a25-ba3b-4bc6-890d-9260f6ca3579 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:31.415195 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6576a25-ba3b-4bc6-890d-9260f6ca3579 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:31.420192 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69593516-d863-4559-9a5e-c0390a7ef984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:31.420786 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593516-d863-4559-9a5e-c0390a7ef984 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:31.421161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593516-d863-4559-9a5e-c0390a7ef984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:31.421465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69593516-d863-4559-9a5e-c0390a7ef984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:31.422110 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69593516-d863-4559-9a5e-c0390a7ef984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:31.423718 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69593516-d863-4559-9a5e-c0390a7ef984 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:31.434927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1247/2489] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:31.438959 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e129ea6-b650-4ca0-897d-100c6d0db422 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:31.449428 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e129ea6-b650-4ca0-897d-100c6d0db422 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:31.454024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29275e0-ea84-41dd-9a9a-fe08f5ad4848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:31.454609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29275e0-ea84-41dd-9a9a-fe08f5ad4848 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:31.454879 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29275e0-ea84-41dd-9a9a-fe08f5ad4848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:31.455144 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29275e0-ea84-41dd-9a9a-fe08f5ad4848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:31.455776 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29275e0-ea84-41dd-9a9a-fe08f5ad4848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:31.457384 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29275e0-ea84-41dd-9a9a-fe08f5ad4848 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:31.462595 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:31.468287 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1243/2490] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:31.472603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69593516-d863-4559-9a5e-c0390a7ef984 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:31.482573 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69593516-d863-4559-9a5e-c0390a7ef984 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:31.487203 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cb818-dc72-4db3-93e1-75e0a1af582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:31.487819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cb818-dc72-4db3-93e1-75e0a1af582e admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:31.488063 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cb818-dc72-4db3-93e1-75e0a1af582e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:31.488336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cb818-dc72-4db3-93e1-75e0a1af582e admin admin] PATH_INFO: `/v3/projects/ac82227c8a2e48248a25f52c977c5eb5/users/0edc23ba556543e68e0cd39bf6202bbc/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:31.503780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cb818-dc72-4db3-93e1-75e0a1af582e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac82227c8a2e48248a25f52c977c5eb5, user_id=0edc23ba556543e68e0cd39bf6202bbc, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:31.506634 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4cb818-dc72-4db3-93e1-75e0a1af582e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:31.606091 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1248/2491] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:31 2022] PUT /identity/v3/projects/ac82227c8a2e48248a25f52c977c5eb5/users/0edc23ba556543e68e0cd39bf6202bbc/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:31.616643 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310be31-2449-49b8-989a-ab9804508ac6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:31.616929 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310be31-2449-49b8-989a-ab9804508ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:31.617197 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310be31-2449-49b8-989a-ab9804508ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:31.645503 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d310be31-2449-49b8-989a-ab9804508ac6 None None] MFA Rules not processed for user `0edc23ba556543e68e0cd39bf6202bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:31.646705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d310be31-2449-49b8-989a-ab9804508ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:31.711279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1244/2492] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:31.715987 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cb818-dc72-4db3-93e1-75e0a1af582e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:31.767635 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:31.778531 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cb818-dc72-4db3-93e1-75e0a1af582e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:31.783091 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab95b48-1c0b-472e-9efe-c3cc0079b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:31.783686 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab95b48-1c0b-472e-9efe-c3cc0079b63b admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:31.783956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab95b48-1c0b-472e-9efe-c3cc0079b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:31.784220 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab95b48-1c0b-472e-9efe-c3cc0079b63b admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:31.784838 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab95b48-1c0b-472e-9efe-c3cc0079b63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:31.786956 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab95b48-1c0b-472e-9efe-c3cc0079b63b admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:31.874669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1249/2493] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:31 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:31.875772 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310be31-2449-49b8-989a-ab9804508ac6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:31.888696 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310be31-2449-49b8-989a-ab9804508ac6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:31.947016 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24326543-9944-407b-819d-e48342a077c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:31.947705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326543-9944-407b-819d-e48342a077c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:31.948092 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326543-9944-407b-819d-e48342a077c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:31.948637 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24326543-9944-407b-819d-e48342a077c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:31.948983 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24326543-9944-407b-819d-e48342a077c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:31.950915 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24326543-9944-407b-819d-e48342a077c5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:31.971827 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab95b48-1c0b-472e-9efe-c3cc0079b63b admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:31.973814 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6ab95b48-1c0b-472e-9efe-c3cc0079b63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:31.987409 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab95b48-1c0b-472e-9efe-c3cc0079b63b admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:31.992119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc933094-dcc6-4955-86c8-77aa40e99ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:31.992743 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc933094-dcc6-4955-86c8-77aa40e99ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:31.993019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc933094-dcc6-4955-86c8-77aa40e99ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:31.993323 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc933094-dcc6-4955-86c8-77aa40e99ea2 admin admin] PATH_INFO: `/v3/users/60cc1db21e9c48b4b1ce13d4c263c8e5` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:31.994506 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc933094-dcc6-4955-86c8-77aa40e99ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60cc1db21e9c48b4b1ce13d4c263c8e5)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:31.996480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc933094-dcc6-4955-86c8-77aa40e99ea2 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:32.035296 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1245/2494] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:31 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:32.039034 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24326543-9944-407b-819d-e48342a077c5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:32.050146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24326543-9944-407b-819d-e48342a077c5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:32.054798 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3015f-4a7d-41ea-9231-0115ba157770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:32.055624 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3015f-4a7d-41ea-9231-0115ba157770 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:32.055910 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3015f-4a7d-41ea-9231-0115ba157770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:32.058672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3015f-4a7d-41ea-9231-0115ba157770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:32.058672 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3015f-4a7d-41ea-9231-0115ba157770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:32.058931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3015f-4a7d-41ea-9231-0115ba157770 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:32.068837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1246/2495] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:32.073069 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3015f-4a7d-41ea-9231-0115ba157770 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:32.082607 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3015f-4a7d-41ea-9231-0115ba157770 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:32.090035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4bbcc-1c60-423e-aedb-a1a71acec9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:32.090035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4bbcc-1c60-423e-aedb-a1a71acec9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:32.090035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4bbcc-1c60-423e-aedb-a1a71acec9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:32.090035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4bbcc-1c60-423e-aedb-a1a71acec9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:32.090338 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4bbcc-1c60-423e-aedb-a1a71acec9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:32.091889 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4bbcc-1c60-423e-aedb-a1a71acec9c2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:32.104546 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1247/2496] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:32.108689 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4bbcc-1c60-423e-aedb-a1a71acec9c2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:32.119867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4bbcc-1c60-423e-aedb-a1a71acec9c2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:32.124634 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e48d8-b4c4-4f3e-baf5-de609cee7837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:32.125374 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e48d8-b4c4-4f3e-baf5-de609cee7837 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:32.125663 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e48d8-b4c4-4f3e-baf5-de609cee7837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:32.125935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e48d8-b4c4-4f3e-baf5-de609cee7837 admin admin] PATH_INFO: `/v3/projects/80329fa5038b4f8c90ba9a53f1ee2933/users/3db10558867445baaefa4792b2a48af1/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:32.141539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e48d8-b4c4-4f3e-baf5-de609cee7837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80329fa5038b4f8c90ba9a53f1ee2933, user_id=3db10558867445baaefa4792b2a48af1, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:32.144181 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e48d8-b4c4-4f3e-baf5-de609cee7837 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:32.242806 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bc933094-dcc6-4955-86c8-77aa40e99ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60cc1db21e9c48b4b1ce13d4c263c8e5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:32.243504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bc933094-dcc6-4955-86c8-77aa40e99ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60cc1db21e9c48b4b1ce13d4c263c8e5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:32.256138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bc933094-dcc6-4955-86c8-77aa40e99ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60cc1db21e9c48b4b1ce13d4c263c8e5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:32.257001 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bc933094-dcc6-4955-86c8-77aa40e99ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60cc1db21e9c48b4b1ce13d4c263c8e5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:32.263111 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1248/2497] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:32 2022] PUT /identity/v3/projects/80329fa5038b4f8c90ba9a53f1ee2933/users/3db10558867445baaefa4792b2a48af1/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:32.274384 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d79b67-053a-4f81-8e31-2d6f448650ce None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:32.274667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d79b67-053a-4f81-8e31-2d6f448650ce None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:32.274937 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d79b67-053a-4f81-8e31-2d6f448650ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:32.303293 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-81d79b67-053a-4f81-8e31-2d6f448650ce None None] MFA Rules not processed for user `3db10558867445baaefa4792b2a48af1`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:32.304486 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-81d79b67-053a-4f81-8e31-2d6f448650ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:32.324944 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:32.342552 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-bc933094-dcc6-4955-86c8-77aa40e99ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60cc1db21e9c48b4b1ce13d4c263c8e5'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:32.357442 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1250/2498] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:31 2022] DELETE /identity/v3/users/60cc1db21e9c48b4b1ce13d4c263c8e5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:32.361893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b28f2-719a-419b-ab24-a7290013625a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:32.362245 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b28f2-719a-419b-ab24-a7290013625a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:32.362574 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b28f2-719a-419b-ab24-a7290013625a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:32.371132 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1249/2499] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:32.382828 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-a46b28f2-719a-419b-ab24-a7290013625a None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:32.384106 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a46b28f2-719a-419b-ab24-a7290013625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:32.387783 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d79b67-053a-4f81-8e31-2d6f448650ce None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:32.389141 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-81d79b67-053a-4f81-8e31-2d6f448650ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:32.452163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1251/2500] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:32.458323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d79b67-053a-4f81-8e31-2d6f448650ce None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:32.462259 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b28f2-719a-419b-ab24-a7290013625a None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:32.463858 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a7e7a-d4a6-4293-903e-7ea5dc2e8b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:32.464391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a46b28f2-719a-419b-ab24-a7290013625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:32.464521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a7e7a-d4a6-4293-903e-7ea5dc2e8b41 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:32.464734 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a7e7a-d4a6-4293-903e-7ea5dc2e8b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:32.465045 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a7e7a-d4a6-4293-903e-7ea5dc2e8b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:32.465712 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a7e7a-d4a6-4293-903e-7ea5dc2e8b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:32.467692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a7e7a-d4a6-4293-903e-7ea5dc2e8b41 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:32.518955 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:32.522595 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b28f2-719a-419b-ab24-a7290013625a None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:32.526428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d28ea6-cb4c-42a4-a70e-77d4cf6836f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:32.527057 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d28ea6-cb4c-42a4-a70e-77d4cf6836f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:32.527336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d28ea6-cb4c-42a4-a70e-77d4cf6836f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:32.527602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d28ea6-cb4c-42a4-a70e-77d4cf6836f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:32.536590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d28ea6-cb4c-42a4-a70e-77d4cf6836f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:32.539112 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d28ea6-cb4c-42a4-a70e-77d4cf6836f7 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:32.548017 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1252/2501] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:32.598182 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1250/2502] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:32 2022] POST /identity/v3/projects => generated 383 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:32.599359 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d28ea6-cb4c-42a4-a70e-77d4cf6836f7 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:32.609926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d28ea6-cb4c-42a4-a70e-77d4cf6836f7 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:32.668024 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f60009-5a30-4051-b776-4490f998664e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:32.668625 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f60009-5a30-4051-b776-4490f998664e admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:32.668899 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f60009-5a30-4051-b776-4490f998664e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:32.669165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f60009-5a30-4051-b776-4490f998664e admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:32.669856 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f60009-5a30-4051-b776-4490f998664e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:32.671744 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f60009-5a30-4051-b776-4490f998664e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:32.770716 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1253/2503] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:32 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:32.774796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a7e7a-d4a6-4293-903e-7ea5dc2e8b41 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:32.786719 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a7e7a-d4a6-4293-903e-7ea5dc2e8b41 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:32.792341 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a88149-774f-4949-af97-33668545cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:32.793131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a88149-774f-4949-af97-33668545cf30 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:32.793448 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a88149-774f-4949-af97-33668545cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:32.793737 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a88149-774f-4949-af97-33668545cf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:32.794431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a88149-774f-4949-af97-33668545cf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:32.796063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a88149-774f-4949-af97-33668545cf30 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:32.808858 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1251/2504] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:32.813117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f60009-5a30-4051-b776-4490f998664e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:32.823602 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f60009-5a30-4051-b776-4490f998664e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:32.828809 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd1143-2b3d-41ed-8a6f-1e344e745586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:32.829581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd1143-2b3d-41ed-8a6f-1e344e745586 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:32.829862 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd1143-2b3d-41ed-8a6f-1e344e745586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:32.830134 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd1143-2b3d-41ed-8a6f-1e344e745586 admin admin] PATH_INFO: `/v3/projects/61186557bb514e32930ac2fdf7afb7ac/users/ea7faf19eae54dcaa2d0a0c1bcbe70c8/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:32.847202 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd1143-2b3d-41ed-8a6f-1e344e745586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61186557bb514e32930ac2fdf7afb7ac, user_id=ea7faf19eae54dcaa2d0a0c1bcbe70c8, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:32.850000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd1143-2b3d-41ed-8a6f-1e344e745586 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:32.925061 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1254/2505] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:32 2022] PUT /identity/v3/projects/61186557bb514e32930ac2fdf7afb7ac/users/ea7faf19eae54dcaa2d0a0c1bcbe70c8/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:32.929135 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a88149-774f-4949-af97-33668545cf30 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:32.939304 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a88149-774f-4949-af97-33668545cf30 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:32.996250 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b3625-9c0c-486c-9460-eaa7a288a28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:32.997040 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b3625-9c0c-486c-9460-eaa7a288a28c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:32.997400 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b3625-9c0c-486c-9460-eaa7a288a28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:32.997729 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b3625-9c0c-486c-9460-eaa7a288a28c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:32.998424 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b3625-9c0c-486c-9460-eaa7a288a28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:33.000150 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b3625-9c0c-486c-9460-eaa7a288a28c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:33.000522 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd1143-2b3d-41ed-8a6f-1e344e745586 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:33.002365 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-93fd1143-2b3d-41ed-8a6f-1e344e745586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:33.010863 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1252/2506] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:33.014726 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b3625-9c0c-486c-9460-eaa7a288a28c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:33.018627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd1143-2b3d-41ed-8a6f-1e344e745586 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:33.024503 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:33.024947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b3625-9c0c-486c-9460-eaa7a288a28c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:33.025179 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:33.026142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:33.026377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] PATH_INFO: `/v3/projects/60cae8aa341e458f8eac18ef26bdcceb` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:33.027753 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] RBAC: Authorizing `identity:delete_project(project_id=60cae8aa341e458f8eac18ef26bdcceb)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:33.030517 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:33.030862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75cd83-4d8d-4b2d-8082-13d38662e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:33.031475 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75cd83-4d8d-4b2d-8082-13d38662e83e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:33.031804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75cd83-4d8d-4b2d-8082-13d38662e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:33.031999 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75cd83-4d8d-4b2d-8082-13d38662e83e admin admin] PATH_INFO: `/v3/projects/61186557bb514e32930ac2fdf7afb7ac/users/ea7faf19eae54dcaa2d0a0c1bcbe70c8/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:33.033938 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75cd83-4d8d-4b2d-8082-13d38662e83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61186557bb514e32930ac2fdf7afb7ac, user_id=ea7faf19eae54dcaa2d0a0c1bcbe70c8, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:33.036650 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75cd83-4d8d-4b2d-8082-13d38662e83e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:33.048774 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1253/2507] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:33 2022] PUT /identity/v3/projects/61186557bb514e32930ac2fdf7afb7ac/users/ea7faf19eae54dcaa2d0a0c1bcbe70c8/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:33.059379 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad247f-0721-4e03-b08f-72787ff3214c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:33.059692 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad247f-0721-4e03-b08f-72787ff3214c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:33.059980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad247f-0721-4e03-b08f-72787ff3214c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:33.088963 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-37ad247f-0721-4e03-b08f-72787ff3214c None None] MFA Rules not processed for user `ea7faf19eae54dcaa2d0a0c1bcbe70c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:33.090281 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-37ad247f-0721-4e03-b08f-72787ff3214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:33.098497 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:33.159653 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1254/2508] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:33.173322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad247f-0721-4e03-b08f-72787ff3214c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:33.174590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60cae8aa341e458f8eac18ef26bdcceb', 'request_id': 'req-de5586fc-badd-4c0c-9c2d-54931b16fadb'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:33.174830 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-37ad247f-0721-4e03-b08f-72787ff3214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:33.235015 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad247f-0721-4e03-b08f-72787ff3214c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:33.262759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60cae8aa341e458f8eac18ef26bdcceb', 'request_id': 'req-de5586fc-badd-4c0c-9c2d-54931b16fadb'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:33.269655 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60cae8aa341e458f8eac18ef26bdcceb', 'request_id': 'req-de5586fc-badd-4c0c-9c2d-54931b16fadb'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:33.281510 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] The token cache is being invalidate because project 60cae8aa341e458f8eac18ef26bdcceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:33.281798 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:33.282449 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:33.283024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f4715-5d52-446b-b887-ead80cd16de0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:33.283629 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f4715-5d52-446b-b887-ead80cd16de0 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:33.283902 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f4715-5d52-446b-b887-ead80cd16de0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:33.284010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1255/2509] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:32 2022] DELETE /identity/v3/projects/60cae8aa341e458f8eac18ef26bdcceb => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:33.284464 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f4715-5d52-446b-b887-ead80cd16de0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:33.286225 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e57f4715-5d52-446b-b887-ead80cd16de0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:33.287875 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:33.289330 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:33.334984 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:33.350926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f4715-5d52-446b-b887-ead80cd16de0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:33.352299 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f4715-5d52-446b-b887-ead80cd16de0 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:33.356539 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5586fc-badd-4c0c-9c2d-54931b16fadb admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:33.361312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:33.361468 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1255/2510] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:33.361965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:33.362246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:33.362603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] PATH_INFO: `/v3/users/38383294e7914464b8268a98a0091de2` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:33.363837 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38383294e7914464b8268a98a0091de2)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:33.365834 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:33.584272 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38383294e7914464b8268a98a0091de2'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:33.584919 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38383294e7914464b8268a98a0091de2'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:33.597415 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38383294e7914464b8268a98a0091de2'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:33.598045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38383294e7914464b8268a98a0091de2'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:33.766058 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38383294e7914464b8268a98a0091de2'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:33.779580 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1256/2511] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:33 2022] DELETE /identity/v3/users/38383294e7914464b8268a98a0091de2 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:34.309103 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f4715-5d52-446b-b887-ead80cd16de0 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:34.321660 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f4715-5d52-446b-b887-ead80cd16de0 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:34.337945 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:34.389201 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baed3a-7fe9-4913-9715-ee14486a6466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:34.389881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baed3a-7fe9-4913-9715-ee14486a6466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:34.390163 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baed3a-7fe9-4913-9715-ee14486a6466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:34.390440 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baed3a-7fe9-4913-9715-ee14486a6466 admin admin] PATH_INFO: `/v3/projects/fe02b4eb8bc14a20b6df1edc598928ca` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:34.391609 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0baed3a-7fe9-4913-9715-ee14486a6466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe02b4eb8bc14a20b6df1edc598928ca)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:34.393701 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0baed3a-7fe9-4913-9715-ee14486a6466 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:34.480739 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e0baed3a-7fe9-4913-9715-ee14486a6466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe02b4eb8bc14a20b6df1edc598928ca', 'request_id': 'req-e0baed3a-7fe9-4913-9715-ee14486a6466'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:34.496679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:34.498146 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:34.511700 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fbfff-3a6d-4f32-9cf0-d76505d84bb0 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:34.530973 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e0baed3a-7fe9-4913-9715-ee14486a6466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe02b4eb8bc14a20b6df1edc598928ca', 'request_id': 'req-e0baed3a-7fe9-4913-9715-ee14486a6466'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:34.537763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e0baed3a-7fe9-4913-9715-ee14486a6466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe02b4eb8bc14a20b6df1edc598928ca', 'request_id': 'req-e0baed3a-7fe9-4913-9715-ee14486a6466'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:34.548947 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e0baed3a-7fe9-4913-9715-ee14486a6466 admin admin] The token cache is being invalidate because project fe02b4eb8bc14a20b6df1edc598928ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:34.549452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e0baed3a-7fe9-4913-9715-ee14486a6466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:34.550093 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e0baed3a-7fe9-4913-9715-ee14486a6466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:34.551664 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1256/2512] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:34 2022] DELETE /identity/v3/projects/fe02b4eb8bc14a20b6df1edc598928ca => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:34.557826 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e909cd7-4686-4d2c-901d-9bb8f54cd6b6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:34.558105 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e909cd7-4686-4d2c-901d-9bb8f54cd6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:34.558380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e909cd7-4686-4d2c-901d-9bb8f54cd6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:34.574214 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04c7a-57ff-4232-a88f-9b6f11f8f411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:34.574896 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04c7a-57ff-4232-a88f-9b6f11f8f411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:34.575176 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04c7a-57ff-4232-a88f-9b6f11f8f411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:34.575448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04c7a-57ff-4232-a88f-9b6f11f8f411 admin admin] PATH_INFO: `/v3/users/8578a6418a894014b9288683709303ea` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:34.576591 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d04c7a-57ff-4232-a88f-9b6f11f8f411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8578a6418a894014b9288683709303ea)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:34.578545 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d04c7a-57ff-4232-a88f-9b6f11f8f411 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:34.578670 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4e909cd7-4686-4d2c-901d-9bb8f54cd6b6 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:34.579747 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4e909cd7-4686-4d2c-901d-9bb8f54cd6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:34.587511 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1257/2513] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:34.598552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979bcca-8449-4d93-a431-dcf369a46650 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:34.600388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979bcca-8449-4d93-a431-dcf369a46650 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:34.600388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979bcca-8449-4d93-a431-dcf369a46650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:34.619939 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f979bcca-8449-4d93-a431-dcf369a46650 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:34.621179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f979bcca-8449-4d93-a431-dcf369a46650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:34.629207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1258/2514] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:34.633194 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979bcca-8449-4d93-a431-dcf369a46650 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:34.642946 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979bcca-8449-4d93-a431-dcf369a46650 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:34.647430 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c09b96-b43d-42e7-b414-26660e07e7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:34.647997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c09b96-b43d-42e7-b414-26660e07e7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:34.648276 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c09b96-b43d-42e7-b414-26660e07e7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:34.648589 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c09b96-b43d-42e7-b414-26660e07e7a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:34.649222 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c09b96-b43d-42e7-b414-26660e07e7a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:19:34.649552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c09b96-b43d-42e7-b414-26660e07e7a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:34.652051 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c09b96-b43d-42e7-b414-26660e07e7a2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:34.663433 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1259/2515] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:19:34.667570 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c09b96-b43d-42e7-b414-26660e07e7a2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:34.676765 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c09b96-b43d-42e7-b414-26660e07e7a2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:34.681917 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffeeb3-1739-4593-aa86-7afe07f9609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:34.682522 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffeeb3-1739-4593-aa86-7afe07f9609f admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:34.682797 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffeeb3-1739-4593-aa86-7afe07f9609f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:34.683066 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffeeb3-1739-4593-aa86-7afe07f9609f admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:34.683679 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffeeb3-1739-4593-aa86-7afe07f9609f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:34.685541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffeeb3-1739-4593-aa86-7afe07f9609f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:34.802796 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-02d04c7a-57ff-4232-a88f-9b6f11f8f411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8578a6418a894014b9288683709303ea'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:34.803377 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-02d04c7a-57ff-4232-a88f-9b6f11f8f411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8578a6418a894014b9288683709303ea'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:34.814244 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:34.816513 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-02d04c7a-57ff-4232-a88f-9b6f11f8f411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8578a6418a894014b9288683709303ea'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:34.817445 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-02d04c7a-57ff-4232-a88f-9b6f11f8f411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8578a6418a894014b9288683709303ea'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:34.818264 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1260/2516] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:34 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:34.822834 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffeeb3-1739-4593-aa86-7afe07f9609f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:34.824505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-36ffeeb3-1739-4593-aa86-7afe07f9609f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:34.885137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:34.888663 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffeeb3-1739-4593-aa86-7afe07f9609f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:34.893259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c4376-7ac2-47a3-a60d-c0d88282ce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:34.893883 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c4376-7ac2-47a3-a60d-c0d88282ce6e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:34.894156 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c4376-7ac2-47a3-a60d-c0d88282ce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:34.894441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c4376-7ac2-47a3-a60d-c0d88282ce6e admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:34.895035 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c4376-7ac2-47a3-a60d-c0d88282ce6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:34.897163 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c4376-7ac2-47a3-a60d-c0d88282ce6e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:34.920733 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-02d04c7a-57ff-4232-a88f-9b6f11f8f411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8578a6418a894014b9288683709303ea'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:34.933630 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1257/2517] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:34 2022] DELETE /identity/v3/users/8578a6418a894014b9288683709303ea => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:34.937858 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea4391-d048-41b9-a097-dc91ab6b5861 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:34.938136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea4391-d048-41b9-a097-dc91ab6b5861 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:34.938414 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea4391-d048-41b9-a097-dc91ab6b5861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:34.957533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-08ea4391-d048-41b9-a097-dc91ab6b5861 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:34.963832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-08ea4391-d048-41b9-a097-dc91ab6b5861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:34.988867 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1261/2518] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:34 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:34.992832 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c4376-7ac2-47a3-a60d-c0d88282ce6e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:35.002898 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c4376-7ac2-47a3-a60d-c0d88282ce6e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:35.022863 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1258/2519] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:35.032773 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea4391-d048-41b9-a097-dc91ab6b5861 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:35.034170 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-08ea4391-d048-41b9-a097-dc91ab6b5861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:35.062031 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cf11d-ef76-48d6-92ac-f893ba52bc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:35.062565 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cf11d-ef76-48d6-92ac-f893ba52bc1e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:35.062842 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cf11d-ef76-48d6-92ac-f893ba52bc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:35.063113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7cf11d-ef76-48d6-92ac-f893ba52bc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:35.063758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cf11d-ef76-48d6-92ac-f893ba52bc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:35.065379 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7cf11d-ef76-48d6-92ac-f893ba52bc1e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:35.075885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1262/2520] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:35.079801 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cf11d-ef76-48d6-92ac-f893ba52bc1e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:35.089359 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7cf11d-ef76-48d6-92ac-f893ba52bc1e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:35.091690 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea4391-d048-41b9-a097-dc91ab6b5861 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:35.094318 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6c073-b6df-4e7f-b6d6-181b900defdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:35.094933 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c073-b6df-4e7f-b6d6-181b900defdb admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:35.095211 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c073-b6df-4e7f-b6d6-181b900defdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:35.095550 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c073-b6df-4e7f-b6d6-181b900defdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:35.096142 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc10db2-5fe7-4d50-af7c-07d4282558ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:35.096282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6c073-b6df-4e7f-b6d6-181b900defdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:35.096872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc10db2-5fe7-4d50-af7c-07d4282558ac service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:35.097212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc10db2-5fe7-4d50-af7c-07d4282558ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:35.097565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc10db2-5fe7-4d50-af7c-07d4282558ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:35.097813 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6c073-b6df-4e7f-b6d6-181b900defdb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:35.107153 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc10db2-5fe7-4d50-af7c-07d4282558ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:35.108589 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc10db2-5fe7-4d50-af7c-07d4282558ac service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:35.112404 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1263/2521] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:35.113496 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6c073-b6df-4e7f-b6d6-181b900defdb admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:35.119643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1259/2522] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:35.123925 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6c073-b6df-4e7f-b6d6-181b900defdb admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:35.128705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babacddb-9c8f-4ec5-8a62-12988e7ee578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:35.129388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babacddb-9c8f-4ec5-8a62-12988e7ee578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:35.129667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babacddb-9c8f-4ec5-8a62-12988e7ee578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:35.129938 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babacddb-9c8f-4ec5-8a62-12988e7ee578 admin admin] PATH_INFO: `/v3/projects/cb5b6c1cfcfd4f979767902c5675b983/users/147eb39ae4614406ac387e71cf9d7cd9/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:35.145843 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babacddb-9c8f-4ec5-8a62-12988e7ee578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5b6c1cfcfd4f979767902c5675b983, user_id=147eb39ae4614406ac387e71cf9d7cd9, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:35.151079 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babacddb-9c8f-4ec5-8a62-12988e7ee578 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:35.268884 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1264/2523] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:35 2022] PUT /identity/v3/projects/cb5b6c1cfcfd4f979767902c5675b983/users/147eb39ae4614406ac387e71cf9d7cd9/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:35.279414 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85898542-7900-4e9d-af2a-f37c05c2dc78 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:35.279770 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85898542-7900-4e9d-af2a-f37c05c2dc78 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:35.280107 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85898542-7900-4e9d-af2a-f37c05c2dc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:35.321589 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-85898542-7900-4e9d-af2a-f37c05c2dc78 None None] MFA Rules not processed for user `147eb39ae4614406ac387e71cf9d7cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:35.321589 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-85898542-7900-4e9d-af2a-f37c05c2dc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:35.399539 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1260/2524] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:35.404261 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babacddb-9c8f-4ec5-8a62-12988e7ee578 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:35.473384 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babacddb-9c8f-4ec5-8a62-12988e7ee578 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:35.478136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddb994-985f-41d1-ac23-914957a45cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:35.479549 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddb994-985f-41d1-ac23-914957a45cbd admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:35.479831 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddb994-985f-41d1-ac23-914957a45cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:35.480100 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ddb994-985f-41d1-ac23-914957a45cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:35.480756 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ddb994-985f-41d1-ac23-914957a45cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:35.482707 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ddb994-985f-41d1-ac23-914957a45cbd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:35.584644 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1265/2525] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:35 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:35.590366 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85898542-7900-4e9d-af2a-f37c05c2dc78 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:35.608399 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85898542-7900-4e9d-af2a-f37c05c2dc78 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:35.608736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddb994-985f-41d1-ac23-914957a45cbd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:35.610529 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-75ddb994-985f-41d1-ac23-914957a45cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:35.617726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:35.652750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:35.676233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd763854-d564-4417-b53e-e1de00edae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:35.676508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ddb994-985f-41d1-ac23-914957a45cbd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:35.676922 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd763854-d564-4417-b53e-e1de00edae10 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:35.677137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd763854-d564-4417-b53e-e1de00edae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:35.677573 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd763854-d564-4417-b53e-e1de00edae10 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:35.678216 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd763854-d564-4417-b53e-e1de00edae10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:35.680198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd763854-d564-4417-b53e-e1de00edae10 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:35.680573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5a558-2724-433c-a3c7-e8bda9c61388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:35.681075 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5a558-2724-433c-a3c7-e8bda9c61388 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:35.681510 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5a558-2724-433c-a3c7-e8bda9c61388 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:35.681777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5a558-2724-433c-a3c7-e8bda9c61388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:35.683572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-27a5a558-2724-433c-a3c7-e8bda9c61388 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:35.748460 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5a558-2724-433c-a3c7-e8bda9c61388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:35.749930 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5a558-2724-433c-a3c7-e8bda9c61388 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:35.759361 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1266/2526] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:35.823966 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1261/2527] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:35 2022] POST /identity/v3/users => generated 300 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:35.831738 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5a558-2724-433c-a3c7-e8bda9c61388 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:35.838282 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5a558-2724-433c-a3c7-e8bda9c61388 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:35.842760 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4b1ee-1a31-4cdd-a91d-91c443d7daa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:35.843351 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4b1ee-1a31-4cdd-a91d-91c443d7daa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:35.843625 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4b1ee-1a31-4cdd-a91d-91c443d7daa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:35.843894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4b1ee-1a31-4cdd-a91d-91c443d7daa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:35.844553 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4b1ee-1a31-4cdd-a91d-91c443d7daa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:35.846178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4b1ee-1a31-4cdd-a91d-91c443d7daa6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:35.855923 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1267/2528] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:35.860048 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd763854-d564-4417-b53e-e1de00edae10 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:35.879582 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd763854-d564-4417-b53e-e1de00edae10 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:35.879582 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cc2fa-064b-4777-9458-b6b7ae67cc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:35.879582 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cc2fa-064b-4777-9458-b6b7ae67cc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:35.879582 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cc2fa-064b-4777-9458-b6b7ae67cc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:35.879946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cc2fa-064b-4777-9458-b6b7ae67cc84 admin admin] PATH_INFO: `/v3/projects/ca0b449f6ba745938b6118c4da7c8d37/users/20976ba1f9214d9183cce548589b4431/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:35.880447 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4b1ee-1a31-4cdd-a91d-91c443d7daa6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:35.882162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4db4b1ee-1a31-4cdd-a91d-91c443d7daa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:35.896169 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4b1ee-1a31-4cdd-a91d-91c443d7daa6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:35.898757 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cc2fa-064b-4777-9458-b6b7ae67cc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0b449f6ba745938b6118c4da7c8d37, user_id=20976ba1f9214d9183cce548589b4431, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:35.901805 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cc2fa-064b-4777-9458-b6b7ae67cc84 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:35.901943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87591-ac1e-4592-a5d3-7d559301e4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:35.902554 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87591-ac1e-4592-a5d3-7d559301e4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:35.902829 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87591-ac1e-4592-a5d3-7d559301e4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:35.903099 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87591-ac1e-4592-a5d3-7d559301e4fc admin admin] PATH_INFO: `/v3/projects/d33eb16a0a6f4b5b8f56efacf7f23670` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:35.904233 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87591-ac1e-4592-a5d3-7d559301e4fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d33eb16a0a6f4b5b8f56efacf7f23670)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:35.906204 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87591-ac1e-4592-a5d3-7d559301e4fc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:36.058145 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1262/2529] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:35 2022] PUT /identity/v3/projects/ca0b449f6ba745938b6118c4da7c8d37/users/20976ba1f9214d9183cce548589b4431/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:36.062081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cc2fa-064b-4777-9458-b6b7ae67cc84 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:36.073523 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9ca87591-ac1e-4592-a5d3-7d559301e4fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd33eb16a0a6f4b5b8f56efacf7f23670', 'request_id': 'req-9ca87591-ac1e-4592-a5d3-7d559301e4fc'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:36.123397 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cc2fa-064b-4777-9458-b6b7ae67cc84 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:36.160435 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9ca87591-ac1e-4592-a5d3-7d559301e4fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd33eb16a0a6f4b5b8f56efacf7f23670', 'request_id': 'req-9ca87591-ac1e-4592-a5d3-7d559301e4fc'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:36.168979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9ca87591-ac1e-4592-a5d3-7d559301e4fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd33eb16a0a6f4b5b8f56efacf7f23670', 'request_id': 'req-9ca87591-ac1e-4592-a5d3-7d559301e4fc'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:36.179347 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9ca87591-ac1e-4592-a5d3-7d559301e4fc admin admin] The token cache is being invalidate because project d33eb16a0a6f4b5b8f56efacf7f23670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:36.179731 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9ca87591-ac1e-4592-a5d3-7d559301e4fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:36.180689 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9ca87591-ac1e-4592-a5d3-7d559301e4fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:36.182533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76e00d-a5f7-4b5c-9783-00863eae0d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:36.182978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1268/2530] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:35 2022] DELETE /identity/v3/projects/d33eb16a0a6f4b5b8f56efacf7f23670 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:36.186424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e00d-a5f7-4b5c-9783-00863eae0d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:36.186424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e00d-a5f7-4b5c-9783-00863eae0d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:36.186424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e00d-a5f7-4b5c-9783-00863eae0d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:36.186424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76e00d-a5f7-4b5c-9783-00863eae0d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:36.186424 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76e00d-a5f7-4b5c-9783-00863eae0d62 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:36.187954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3e0cc-b717-4ae4-98c8-d687338aad14 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:36.188236 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3e0cc-b717-4ae4-98c8-d687338aad14 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:36.188505 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3e0cc-b717-4ae4-98c8-d687338aad14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:36.196015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1263/2531] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:19:36.200334 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76e00d-a5f7-4b5c-9783-00863eae0d62 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:36.202128 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-8d76e00d-a5f7-4b5c-9783-00863eae0d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:36.208277 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9af3e0cc-b717-4ae4-98c8-d687338aad14 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:36.209474 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9af3e0cc-b717-4ae4-98c8-d687338aad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:36.215290 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76e00d-a5f7-4b5c-9783-00863eae0d62 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:36.217552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1269/2532] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:36.221141 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620188f-0584-4347-bed2-ab7f801d6be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:36.221415 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620188f-0584-4347-bed2-ab7f801d6be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:36.221849 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620188f-0584-4347-bed2-ab7f801d6be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:36.222123 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620188f-0584-4347-bed2-ab7f801d6be7 admin admin] PATH_INFO: `/v3/projects/ca0b449f6ba745938b6118c4da7c8d37/users/20976ba1f9214d9183cce548589b4431/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:36.224138 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620188f-0584-4347-bed2-ab7f801d6be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0b449f6ba745938b6118c4da7c8d37, user_id=20976ba1f9214d9183cce548589b4431, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:36.226882 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620188f-0584-4347-bed2-ab7f801d6be7 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:36.239452 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1264/2533] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:36 2022] PUT /identity/v3/projects/ca0b449f6ba745938b6118c4da7c8d37/users/20976ba1f9214d9183cce548589b4431/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:36.251544 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917f87c-609e-4636-9b98-5a6a8532ae1f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:36.251823 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917f87c-609e-4636-9b98-5a6a8532ae1f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:36.252098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917f87c-609e-4636-9b98-5a6a8532ae1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:36.283454 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7917f87c-609e-4636-9b98-5a6a8532ae1f None None] MFA Rules not processed for user `20976ba1f9214d9183cce548589b4431`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:36.285073 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7917f87c-609e-4636-9b98-5a6a8532ae1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:36.285212 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ac1fe-dfeb-4d79-8ce4-81d31c7d9393 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:36.285467 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ac1fe-dfeb-4d79-8ce4-81d31c7d9393 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:36.285737 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ac1fe-dfeb-4d79-8ce4-81d31c7d9393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:36.307480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-e90ac1fe-dfeb-4d79-8ce4-81d31c7d9393 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:36.308713 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e90ac1fe-dfeb-4d79-8ce4-81d31c7d9393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:36.358139 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1270/2534] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:36.368979 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917f87c-609e-4636-9b98-5a6a8532ae1f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:36.370068 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1265/2535] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:36.374139 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ac1fe-dfeb-4d79-8ce4-81d31c7d9393 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:36.374545 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7917f87c-609e-4636-9b98-5a6a8532ae1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:36.383267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ac1fe-dfeb-4d79-8ce4-81d31c7d9393 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:36.388056 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376aea0-4189-4661-b666-3ff580ddf2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:36.388654 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376aea0-4189-4661-b666-3ff580ddf2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:36.388934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376aea0-4189-4661-b666-3ff580ddf2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:36.389206 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b376aea0-4189-4661-b666-3ff580ddf2e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:36.389897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376aea0-4189-4661-b666-3ff580ddf2e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:19:36.390198 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376aea0-4189-4661-b666-3ff580ddf2e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:36.391822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b376aea0-4189-4661-b666-3ff580ddf2e7 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:36.403760 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1266/2536] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 31 15:19:36.408191 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376aea0-4189-4661-b666-3ff580ddf2e7 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:36.418644 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b376aea0-4189-4661-b666-3ff580ddf2e7 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:36.423294 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca35282-60e8-4a14-8121-e9033ec93dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:36.423872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca35282-60e8-4a14-8121-e9033ec93dcb admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:36.424147 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca35282-60e8-4a14-8121-e9033ec93dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:36.424420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca35282-60e8-4a14-8121-e9033ec93dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:36.425036 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca35282-60e8-4a14-8121-e9033ec93dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:36.427005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca35282-60e8-4a14-8121-e9033ec93dcb admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:36.434295 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917f87c-609e-4636-9b98-5a6a8532ae1f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:36.437850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace503b6-59fc-4397-854c-cc07a78edb03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:36.438582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace503b6-59fc-4397-854c-cc07a78edb03 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:36.438850 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace503b6-59fc-4397-854c-cc07a78edb03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:36.439116 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace503b6-59fc-4397-854c-cc07a78edb03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:36.448837 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace503b6-59fc-4397-854c-cc07a78edb03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:36.455323 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace503b6-59fc-4397-854c-cc07a78edb03 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:36.459968 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1271/2537] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:36.579066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1267/2538] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:36 2022] POST /identity/v3/projects => generated 399 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:36.583296 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace503b6-59fc-4397-854c-cc07a78edb03 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:36.593687 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace503b6-59fc-4397-854c-cc07a78edb03 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:36.652514 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53955d59-9f1c-4d2c-8c4c-6d95042b3f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:36.654299 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53955d59-9f1c-4d2c-8c4c-6d95042b3f68 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:36.654299 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53955d59-9f1c-4d2c-8c4c-6d95042b3f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:36.654299 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53955d59-9f1c-4d2c-8c4c-6d95042b3f68 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:36.654605 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53955d59-9f1c-4d2c-8c4c-6d95042b3f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:36.656528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53955d59-9f1c-4d2c-8c4c-6d95042b3f68 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:36.737272 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:36.794105 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1272/2539] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:36 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:19:36.794315 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca35282-60e8-4a14-8121-e9033ec93dcb admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:36.804755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca35282-60e8-4a14-8121-e9033ec93dcb admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:36.810313 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4c62c-eccf-4ec0-8160-ec7a1049caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:36.822957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4c62c-eccf-4ec0-8160-ec7a1049caac admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:36.822957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4c62c-eccf-4ec0-8160-ec7a1049caac admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:36.822957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4c62c-eccf-4ec0-8160-ec7a1049caac admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:36.822957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4c62c-eccf-4ec0-8160-ec7a1049caac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:36.822957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4c62c-eccf-4ec0-8160-ec7a1049caac admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:36.825890 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1268/2540] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:36.828592 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53955d59-9f1c-4d2c-8c4c-6d95042b3f68 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:36.839876 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53955d59-9f1c-4d2c-8c4c-6d95042b3f68 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:36.844671 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61184b2-effd-4e40-909f-38f267765621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:36.845405 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61184b2-effd-4e40-909f-38f267765621 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:36.845675 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61184b2-effd-4e40-909f-38f267765621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:36.845941 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61184b2-effd-4e40-909f-38f267765621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:36.846577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61184b2-effd-4e40-909f-38f267765621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:36.848123 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61184b2-effd-4e40-909f-38f267765621 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:36.858831 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1273/2541] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:36.862965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4c62c-eccf-4ec0-8160-ec7a1049caac admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:36.873389 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4c62c-eccf-4ec0-8160-ec7a1049caac admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:36.878020 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6296af-6be0-4576-b813-f12db447fe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:36.878661 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6296af-6be0-4576-b813-f12db447fe26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:36.878934 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6296af-6be0-4576-b813-f12db447fe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:36.879197 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6296af-6be0-4576-b813-f12db447fe26 admin admin] PATH_INFO: `/v3/projects/346d8e85fc42414a9e27c2a4cd142eb5/users/9ec608697db84aa082eaa1c099c40475/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:36.894677 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6296af-6be0-4576-b813-f12db447fe26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=346d8e85fc42414a9e27c2a4cd142eb5, user_id=9ec608697db84aa082eaa1c099c40475, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:36.897366 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6296af-6be0-4576-b813-f12db447fe26 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:36.989850 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1269/2542] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:36 2022] PUT /identity/v3/projects/346d8e85fc42414a9e27c2a4cd142eb5/users/9ec608697db84aa082eaa1c099c40475/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:37.002753 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc013381-e6be-4b5a-a8d1-4926975396de None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:37.003130 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc013381-e6be-4b5a-a8d1-4926975396de None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:37.003471 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc013381-e6be-4b5a-a8d1-4926975396de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:37.032378 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cc013381-e6be-4b5a-a8d1-4926975396de None None] MFA Rules not processed for user `9ec608697db84aa082eaa1c099c40475`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:37.033646 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cc013381-e6be-4b5a-a8d1-4926975396de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:37.046428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:37.099300 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1274/2543] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:37.111646 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6296af-6be0-4576-b813-f12db447fe26 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:37.168341 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6296af-6be0-4576-b813-f12db447fe26 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:37.172049 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518323ee-d0ac-478f-a6f5-4cfb523053b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:37.172695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518323ee-d0ac-478f-a6f5-4cfb523053b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:37.172951 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518323ee-d0ac-478f-a6f5-4cfb523053b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:37.173219 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518323ee-d0ac-478f-a6f5-4cfb523053b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:37.181963 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518323ee-d0ac-478f-a6f5-4cfb523053b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:37.183921 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518323ee-d0ac-478f-a6f5-4cfb523053b5 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:37.193191 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1270/2544] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:37.754844 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:37.767462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc013381-e6be-4b5a-a8d1-4926975396de None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:37.776988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc013381-e6be-4b5a-a8d1-4926975396de None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:37.780477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de873e3-831b-44ff-8371-acd86c0dc749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:37.781058 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de873e3-831b-44ff-8371-acd86c0dc749 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:37.781357 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de873e3-831b-44ff-8371-acd86c0dc749 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:37.781627 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de873e3-831b-44ff-8371-acd86c0dc749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:37.783317 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6de873e3-831b-44ff-8371-acd86c0dc749 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:37.846042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de873e3-831b-44ff-8371-acd86c0dc749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:37.847500 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de873e3-831b-44ff-8371-acd86c0dc749 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:37.857737 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1275/2545] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:38.260092 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518323ee-d0ac-478f-a6f5-4cfb523053b5 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:38.305804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:38.328810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518323ee-d0ac-478f-a6f5-4cfb523053b5 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:38.333509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:38.334183 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:38.334481 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:38.334756 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] PATH_INFO: `/v3/users/147eb39ae4614406ac387e71cf9d7cd9` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:38.335903 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=147eb39ae4614406ac387e71cf9d7cd9)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:38.337970 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:38.499988 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147eb39ae4614406ac387e71cf9d7cd9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:38.500653 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147eb39ae4614406ac387e71cf9d7cd9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:38.513015 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147eb39ae4614406ac387e71cf9d7cd9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:38.513708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147eb39ae4614406ac387e71cf9d7cd9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:38.592412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147eb39ae4614406ac387e71cf9d7cd9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:38.605968 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1271/2546] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:38 2022] DELETE /identity/v3/users/147eb39ae4614406ac387e71cf9d7cd9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:38.610536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a617b-77af-4e11-b77f-7e796e0497b7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:38.610824 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a617b-77af-4e11-b77f-7e796e0497b7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:38.611146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a617b-77af-4e11-b77f-7e796e0497b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:38.630722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c23a617b-77af-4e11-b77f-7e796e0497b7 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:38.631919 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c23a617b-77af-4e11-b77f-7e796e0497b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:38.690314 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1276/2547] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:38.700085 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:38.701514 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:38.758256 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274629d1-e05f-42e6-b9b9-7d4b1e36d7be admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:38.761974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd7290-bcd1-461d-a005-06d3f86344b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:38.762563 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd7290-bcd1-461d-a005-06d3f86344b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:38.762866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd7290-bcd1-461d-a005-06d3f86344b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:38.763131 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd7290-bcd1-461d-a005-06d3f86344b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:38.771791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd7290-bcd1-461d-a005-06d3f86344b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:38.773206 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd7290-bcd1-461d-a005-06d3f86344b6 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:38.782969 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1272/2548] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:39.202344 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a617b-77af-4e11-b77f-7e796e0497b7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:39.204477 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c23a617b-77af-4e11-b77f-7e796e0497b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:39.231052 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a617b-77af-4e11-b77f-7e796e0497b7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:39.236682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:39.237667 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:39.238491 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:39.238975 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] PATH_INFO: `/v3/projects/cb5b6c1cfcfd4f979767902c5675b983` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:39.240489 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb5b6c1cfcfd4f979767902c5675b983)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:39.242716 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:39.372279 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb5b6c1cfcfd4f979767902c5675b983', 'request_id': 'req-4861f481-6778-44d5-b0d7-77e15bc45c06'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:39.489740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb5b6c1cfcfd4f979767902c5675b983', 'request_id': 'req-4861f481-6778-44d5-b0d7-77e15bc45c06'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:39.497093 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb5b6c1cfcfd4f979767902c5675b983', 'request_id': 'req-4861f481-6778-44d5-b0d7-77e15bc45c06'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:39.507715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] The token cache is being invalidate because project cb5b6c1cfcfd4f979767902c5675b983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:39.508001 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:39.508628 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:39.510161 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1277/2549] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:39 2022] DELETE /identity/v3/projects/cb5b6c1cfcfd4f979767902c5675b983 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:39.514815 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd7290-bcd1-461d-a005-06d3f86344b6 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:39.524364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd7290-bcd1-461d-a005-06d3f86344b6 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:39.580310 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:39.580923 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:39.581196 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:39.581491 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] PATH_INFO: `/v3/users/20976ba1f9214d9183cce548589b4431` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:39.582592 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=20976ba1f9214d9183cce548589b4431)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:39.584487 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:39.586881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:39.802122 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20976ba1f9214d9183cce548589b4431'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:39.802878 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20976ba1f9214d9183cce548589b4431'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:39.815286 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20976ba1f9214d9183cce548589b4431'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:39.816117 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20976ba1f9214d9183cce548589b4431'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:39.914357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20976ba1f9214d9183cce548589b4431'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:39.929271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1273/2550] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:39 2022] DELETE /identity/v3/users/20976ba1f9214d9183cce548589b4431 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:40.327740 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:40.329832 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:40.342978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861f481-6778-44d5-b0d7-77e15bc45c06 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:40.346987 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:40.407324 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41809cdd-f8e7-4b66-8ff7-19f888cf813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:40.407997 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809cdd-f8e7-4b66-8ff7-19f888cf813f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:40.408271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809cdd-f8e7-4b66-8ff7-19f888cf813f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:40.408539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809cdd-f8e7-4b66-8ff7-19f888cf813f admin admin] PATH_INFO: `/v3/projects/ca0b449f6ba745938b6118c4da7c8d37` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:40.409701 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41809cdd-f8e7-4b66-8ff7-19f888cf813f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0b449f6ba745938b6118c4da7c8d37)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:40.411562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41809cdd-f8e7-4b66-8ff7-19f888cf813f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:40.519903 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-41809cdd-f8e7-4b66-8ff7-19f888cf813f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0b449f6ba745938b6118c4da7c8d37', 'request_id': 'req-41809cdd-f8e7-4b66-8ff7-19f888cf813f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:40.582198 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-41809cdd-f8e7-4b66-8ff7-19f888cf813f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0b449f6ba745938b6118c4da7c8d37', 'request_id': 'req-41809cdd-f8e7-4b66-8ff7-19f888cf813f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:40.588769 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-41809cdd-f8e7-4b66-8ff7-19f888cf813f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0b449f6ba745938b6118c4da7c8d37', 'request_id': 'req-41809cdd-f8e7-4b66-8ff7-19f888cf813f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:40.599487 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-41809cdd-f8e7-4b66-8ff7-19f888cf813f admin admin] The token cache is being invalidate because project ca0b449f6ba745938b6118c4da7c8d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:40.599790 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-41809cdd-f8e7-4b66-8ff7-19f888cf813f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:40.600402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-41809cdd-f8e7-4b66-8ff7-19f888cf813f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:40.601904 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1278/2551] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:40 2022] DELETE /identity/v3/projects/ca0b449f6ba745938b6118c4da7c8d37 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:42.697892 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:42.699372 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:42.712643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33c3ad-bae0-4cee-a513-4d86aaa0eb3e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:42.770549 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:42.771254 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:42.771533 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:42.771804 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] PATH_INFO: `/v3/users/0edc23ba556543e68e0cd39bf6202bbc` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:42.772913 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edc23ba556543e68e0cd39bf6202bbc)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:42.774952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:43.030940 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edc23ba556543e68e0cd39bf6202bbc'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.031612 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edc23ba556543e68e0cd39bf6202bbc'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.044374 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edc23ba556543e68e0cd39bf6202bbc'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.045005 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edc23ba556543e68e0cd39bf6202bbc'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.125230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edc23ba556543e68e0cd39bf6202bbc'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.134119 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:43.138357 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1274/2552] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:42 2022] DELETE /identity/v3/users/0edc23ba556543e68e0cd39bf6202bbc => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:43.142869 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459734de-7ddf-4636-9dbb-9af7bdd681d2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:43.143336 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459734de-7ddf-4636-9dbb-9af7bdd681d2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:43.143432 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459734de-7ddf-4636-9dbb-9af7bdd681d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:43.163005 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-459734de-7ddf-4636-9dbb-9af7bdd681d2 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:43.164202 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-459734de-7ddf-4636-9dbb-9af7bdd681d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:43.223198 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1279/2553] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:43.233551 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:43.234928 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:43.292098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127559e-ff5d-46cf-b55e-3f75393dd280 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:43.296458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1293ad-4e1b-46b0-b40c-bb73a0207539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:43.297053 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1293ad-4e1b-46b0-b40c-bb73a0207539 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:43.297422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1293ad-4e1b-46b0-b40c-bb73a0207539 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:43.297705 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1293ad-4e1b-46b0-b40c-bb73a0207539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:43.306926 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1293ad-4e1b-46b0-b40c-bb73a0207539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:43.308364 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1293ad-4e1b-46b0-b40c-bb73a0207539 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:43.317948 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1275/2554] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:43.439591 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459734de-7ddf-4636-9dbb-9af7bdd681d2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:43.441013 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-459734de-7ddf-4636-9dbb-9af7bdd681d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:43.453026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459734de-7ddf-4636-9dbb-9af7bdd681d2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:43.457551 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8c3c0-b507-4b63-9f54-bdd9cac12a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:43.458164 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8c3c0-b507-4b63-9f54-bdd9cac12a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:43.458438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8c3c0-b507-4b63-9f54-bdd9cac12a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:43.458706 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8c3c0-b507-4b63-9f54-bdd9cac12a54 admin admin] PATH_INFO: `/v3/users/9ec608697db84aa082eaa1c099c40475` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:43.459796 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8c3c0-b507-4b63-9f54-bdd9cac12a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec608697db84aa082eaa1c099c40475)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:43.462062 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8c3c0-b507-4b63-9f54-bdd9cac12a54 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:43.662537 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:43.675199 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a2c8c3c0-b507-4b63-9f54-bdd9cac12a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec608697db84aa082eaa1c099c40475'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.675854 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a2c8c3c0-b507-4b63-9f54-bdd9cac12a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec608697db84aa082eaa1c099c40475'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.683060 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a2c8c3c0-b507-4b63-9f54-bdd9cac12a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec608697db84aa082eaa1c099c40475'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.726931 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1293ad-4e1b-46b0-b40c-bb73a0207539 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:43.728465 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ef1293ad-4e1b-46b0-b40c-bb73a0207539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:43.741927 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1293ad-4e1b-46b0-b40c-bb73a0207539 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:43.746670 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:43.747974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:43.748255 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:43.748543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] PATH_INFO: `/v3/projects/ac82227c8a2e48248a25f52c977c5eb5` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:43.749695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac82227c8a2e48248a25f52c977c5eb5)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:43.751570 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:43.783601 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a2c8c3c0-b507-4b63-9f54-bdd9cac12a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec608697db84aa082eaa1c099c40475'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.796029 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a2c8c3c0-b507-4b63-9f54-bdd9cac12a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec608697db84aa082eaa1c099c40475'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.802184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1280/2555] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:43 2022] DELETE /identity/v3/users/9ec608697db84aa082eaa1c099c40475 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:43.806819 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0e86-519a-4aef-b5e9-7470964364e8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:43.807098 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0e86-519a-4aef-b5e9-7470964364e8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:43.807369 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0e86-519a-4aef-b5e9-7470964364e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:43.826777 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-203c0e86-519a-4aef-b5e9-7470964364e8 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:43.827980 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-203c0e86-519a-4aef-b5e9-7470964364e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:43.856672 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac82227c8a2e48248a25f52c977c5eb5', 'request_id': 'req-d3206122-8398-4168-924d-ef4bda2b19b9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.887147 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1281/2556] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:43.897392 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0e86-519a-4aef-b5e9-7470964364e8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:43.898754 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-203c0e86-519a-4aef-b5e9-7470964364e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:43.929541 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac82227c8a2e48248a25f52c977c5eb5', 'request_id': 'req-d3206122-8398-4168-924d-ef4bda2b19b9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.937338 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac82227c8a2e48248a25f52c977c5eb5', 'request_id': 'req-d3206122-8398-4168-924d-ef4bda2b19b9'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.948410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] The token cache is being invalidate because project ac82227c8a2e48248a25f52c977c5eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:43.948696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.949346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:43.951346 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1276/2557] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:43 2022] DELETE /identity/v3/projects/ac82227c8a2e48248a25f52c977c5eb5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:43.955494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:43.956771 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0e86-519a-4aef-b5e9-7470964364e8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:43.956889 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:44.011662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac0ebf-f70a-4b4c-9ff3-971acf67c5b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:44.012348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac0ebf-f70a-4b4c-9ff3-971acf67c5b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:44.013173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac0ebf-f70a-4b4c-9ff3-971acf67c5b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:44.013441 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac0ebf-f70a-4b4c-9ff3-971acf67c5b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:44.020951 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-08ac0ebf-f70a-4b4c-9ff3-971acf67c5b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:44.033727 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3206122-8398-4168-924d-ef4bda2b19b9 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:44.034946 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:44.038439 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:44.039066 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:44.039345 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:44.039618 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] PATH_INFO: `/v3/users/3db10558867445baaefa4792b2a48af1` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:44.040747 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3db10558867445baaefa4792b2a48af1)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:44.042701 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:44.079168 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac0ebf-f70a-4b4c-9ff3-971acf67c5b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:44.080582 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac0ebf-f70a-4b4c-9ff3-971acf67c5b1 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:44.089926 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1282/2558] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:19:44.133213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:44.252665 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3db10558867445baaefa4792b2a48af1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:44.253466 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3db10558867445baaefa4792b2a48af1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:44.266260 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3db10558867445baaefa4792b2a48af1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:44.266910 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3db10558867445baaefa4792b2a48af1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:44.383096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3db10558867445baaefa4792b2a48af1'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:44.397052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1277/2559] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:43 2022] DELETE /identity/v3/users/3db10558867445baaefa4792b2a48af1 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:44.524531 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac0ebf-f70a-4b4c-9ff3-971acf67c5b1 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:44.526113 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-08ac0ebf-f70a-4b4c-9ff3-971acf67c5b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:44.542300 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac0ebf-f70a-4b4c-9ff3-971acf67c5b1 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:44.611720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:44.612345 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:44.612619 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:44.612885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] PATH_INFO: `/v3/projects/346d8e85fc42414a9e27c2a4cd142eb5` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:44.614069 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=346d8e85fc42414a9e27c2a4cd142eb5)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:44.615922 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:44.727259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346d8e85fc42414a9e27c2a4cd142eb5', 'request_id': 'req-551180b9-e3b9-44be-81c1-0e0587b2dc79'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:44.803862 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346d8e85fc42414a9e27c2a4cd142eb5', 'request_id': 'req-551180b9-e3b9-44be-81c1-0e0587b2dc79'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:44.813602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346d8e85fc42414a9e27c2a4cd142eb5', 'request_id': 'req-551180b9-e3b9-44be-81c1-0e0587b2dc79'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:44.822508 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] The token cache is being invalidate because project 346d8e85fc42414a9e27c2a4cd142eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:44.822906 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:44.823662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:44.826173 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1283/2560] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:44 2022] DELETE /identity/v3/projects/346d8e85fc42414a9e27c2a4cd142eb5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:44.961640 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:44.963135 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:44.987084 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad9fa9-d111-4d5c-9ebd-94f68fda2475 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:45.066563 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:45.067209 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:45.067490 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:45.067773 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] PATH_INFO: `/v3/projects/80329fa5038b4f8c90ba9a53f1ee2933` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:45.068952 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80329fa5038b4f8c90ba9a53f1ee2933)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:45.070945 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:45.258055 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80329fa5038b4f8c90ba9a53f1ee2933', 'request_id': 'req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:45.377494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80329fa5038b4f8c90ba9a53f1ee2933', 'request_id': 'req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:45.384263 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80329fa5038b4f8c90ba9a53f1ee2933', 'request_id': 'req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:45.394719 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] The token cache is being invalidate because project 80329fa5038b4f8c90ba9a53f1ee2933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:45.395000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:45.395627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:45.397096 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1278/2561] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:44 2022] DELETE /identity/v3/projects/80329fa5038b4f8c90ba9a53f1ee2933 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:45.401136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:45.402593 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:45.415825 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551180b9-e3b9-44be-81c1-0e0587b2dc79 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:45.461012 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:45.473852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393f77d-c0b1-42c5-b0e7-cb8e3137a368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:45.474479 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393f77d-c0b1-42c5-b0e7-cb8e3137a368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:45.474758 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393f77d-c0b1-42c5-b0e7-cb8e3137a368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:45.475031 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393f77d-c0b1-42c5-b0e7-cb8e3137a368 admin admin] PATH_INFO: `/v3/users/ea7faf19eae54dcaa2d0a0c1bcbe70c8` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:45.476136 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393f77d-c0b1-42c5-b0e7-cb8e3137a368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7faf19eae54dcaa2d0a0c1bcbe70c8)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:45.478062 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5393f77d-c0b1-42c5-b0e7-cb8e3137a368 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:45.755236 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5393f77d-c0b1-42c5-b0e7-cb8e3137a368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7faf19eae54dcaa2d0a0c1bcbe70c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:45.755881 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5393f77d-c0b1-42c5-b0e7-cb8e3137a368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7faf19eae54dcaa2d0a0c1bcbe70c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:45.762729 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5393f77d-c0b1-42c5-b0e7-cb8e3137a368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7faf19eae54dcaa2d0a0c1bcbe70c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:45.839102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5393f77d-c0b1-42c5-b0e7-cb8e3137a368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7faf19eae54dcaa2d0a0c1bcbe70c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:45.851986 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5393f77d-c0b1-42c5-b0e7-cb8e3137a368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7faf19eae54dcaa2d0a0c1bcbe70c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:45.858167 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1284/2562] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:19:45 2022] DELETE /identity/v3/users/ea7faf19eae54dcaa2d0a0c1bcbe70c8 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:46.361265 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:46.372252 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:46.381164 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe76fb2-78f2-44a3-9fed-cb9fd6732ec4 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:46.420207 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:46.448861 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b686a5c-27d2-4581-94af-0fe3f5504953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:46.449509 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b686a5c-27d2-4581-94af-0fe3f5504953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:46.449791 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b686a5c-27d2-4581-94af-0fe3f5504953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:46.450064 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b686a5c-27d2-4581-94af-0fe3f5504953 admin admin] PATH_INFO: `/v3/projects/61186557bb514e32930ac2fdf7afb7ac` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:46.452052 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b686a5c-27d2-4581-94af-0fe3f5504953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61186557bb514e32930ac2fdf7afb7ac)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:46.454051 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b686a5c-27d2-4581-94af-0fe3f5504953 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:46.559332 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6b686a5c-27d2-4581-94af-0fe3f5504953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61186557bb514e32930ac2fdf7afb7ac', 'request_id': 'req-6b686a5c-27d2-4581-94af-0fe3f5504953'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:46.631918 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6b686a5c-27d2-4581-94af-0fe3f5504953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61186557bb514e32930ac2fdf7afb7ac', 'request_id': 'req-6b686a5c-27d2-4581-94af-0fe3f5504953'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:46.638724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6b686a5c-27d2-4581-94af-0fe3f5504953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61186557bb514e32930ac2fdf7afb7ac', 'request_id': 'req-6b686a5c-27d2-4581-94af-0fe3f5504953'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:46.649412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6b686a5c-27d2-4581-94af-0fe3f5504953 admin admin] The token cache is being invalidate because project 61186557bb514e32930ac2fdf7afb7ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81684) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:19:46.649698 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6b686a5c-27d2-4581-94af-0fe3f5504953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:46.650329 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6b686a5c-27d2-4581-94af-0fe3f5504953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:19:46.651822 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1279/2563] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:46 2022] DELETE /identity/v3/projects/61186557bb514e32930ac2fdf7afb7ac => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:19:46.656996 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b2cd-d479-4300-8d8a-43b5e61174e8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:46.657296 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b2cd-d479-4300-8d8a-43b5e61174e8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:46.657572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753b2cd-d479-4300-8d8a-43b5e61174e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:46.677074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b753b2cd-d479-4300-8d8a-43b5e61174e8 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:46.678297 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b753b2cd-d479-4300-8d8a-43b5e61174e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:46.737263 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1285/2564] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:46.745188 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fffb4d-eecd-4ed7-bd8f-2ea2fedddb84 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:46.745590 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fffb4d-eecd-4ed7-bd8f-2ea2fedddb84 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:46.746267 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fffb4d-eecd-4ed7-bd8f-2ea2fedddb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:46.766724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-49fffb4d-eecd-4ed7-bd8f-2ea2fedddb84 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:46.767985 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-49fffb4d-eecd-4ed7-bd8f-2ea2fedddb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:46.776041 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1280/2565] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:46.780663 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753b2cd-d479-4300-8d8a-43b5e61174e8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:46.790362 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753b2cd-d479-4300-8d8a-43b5e61174e8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:46.795452 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b251350-5ab5-445e-86ec-512b6a4f24bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:46.796038 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b251350-5ab5-445e-86ec-512b6a4f24bf admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:46.796317 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b251350-5ab5-445e-86ec-512b6a4f24bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:46.796589 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b251350-5ab5-445e-86ec-512b6a4f24bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:46.797235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b251350-5ab5-445e-86ec-512b6a4f24bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:19:46.797573 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b251350-5ab5-445e-86ec-512b6a4f24bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:46.799220 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b251350-5ab5-445e-86ec-512b6a4f24bf admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:46.811636 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1286/2566] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:19:46.815854 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fffb4d-eecd-4ed7-bd8f-2ea2fedddb84 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:46.825225 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fffb4d-eecd-4ed7-bd8f-2ea2fedddb84 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:46.830134 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a1457-7daa-4d95-839a-d5b0cf1f1b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:46.830739 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a1457-7daa-4d95-839a-d5b0cf1f1b02 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:46.831025 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a1457-7daa-4d95-839a-d5b0cf1f1b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:46.834102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a1457-7daa-4d95-839a-d5b0cf1f1b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:46.834102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a1457-7daa-4d95-839a-d5b0cf1f1b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:46.834102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a1457-7daa-4d95-839a-d5b0cf1f1b02 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:46.965419 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1281/2567] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:19:46 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:46.970191 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b251350-5ab5-445e-86ec-512b6a4f24bf admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:46.980978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b251350-5ab5-445e-86ec-512b6a4f24bf admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:47.030301 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:47.039495 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83146f86-d152-4c96-84f7-4e049be7884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:47.040101 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83146f86-d152-4c96-84f7-4e049be7884f admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:47.040373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83146f86-d152-4c96-84f7-4e049be7884f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:47.040641 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83146f86-d152-4c96-84f7-4e049be7884f admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:47.041271 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83146f86-d152-4c96-84f7-4e049be7884f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:47.043198 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83146f86-d152-4c96-84f7-4e049be7884f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:47.142536 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1287/2568] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:19:46 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:19:47.146881 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a1457-7daa-4d95-839a-d5b0cf1f1b02 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:47.158081 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a1457-7daa-4d95-839a-d5b0cf1f1b02 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:47.162965 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ecd07-41a5-4de4-83ab-6b9d2b3e58e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:47.163563 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ecd07-41a5-4de4-83ab-6b9d2b3e58e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:47.163946 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ecd07-41a5-4de4-83ab-6b9d2b3e58e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:47.164221 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ecd07-41a5-4de4-83ab-6b9d2b3e58e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:47.164861 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ecd07-41a5-4de4-83ab-6b9d2b3e58e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:47.166552 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ecd07-41a5-4de4-83ab-6b9d2b3e58e9 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:47.177473 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1282/2569] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:47.181644 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83146f86-d152-4c96-84f7-4e049be7884f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:47.191666 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83146f86-d152-4c96-84f7-4e049be7884f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:47.196965 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecb371-494e-4b77-b5bd-2590298a8c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:47.197617 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecb371-494e-4b77-b5bd-2590298a8c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:47.197894 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecb371-494e-4b77-b5bd-2590298a8c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:47.198162 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecb371-494e-4b77-b5bd-2590298a8c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:47.198819 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecb371-494e-4b77-b5bd-2590298a8c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:47.200384 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecb371-494e-4b77-b5bd-2590298a8c8e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:47.210960 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1288/2570] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:19:47.214989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ecd07-41a5-4de4-83ab-6b9d2b3e58e9 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:47.225951 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ecd07-41a5-4de4-83ab-6b9d2b3e58e9 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:47.230553 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d02b5-7f6f-43a7-864d-5f08e9755d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:47.231425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d02b5-7f6f-43a7-864d-5f08e9755d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:47.231726 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d02b5-7f6f-43a7-864d-5f08e9755d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:47.232078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d02b5-7f6f-43a7-864d-5f08e9755d0f admin admin] PATH_INFO: `/v3/projects/8821e32c806b4c56855d07d720079bb9/users/daeb1c2f561243c39f8a8b6aac36e4a7/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:47.247518 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d02b5-7f6f-43a7-864d-5f08e9755d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8821e32c806b4c56855d07d720079bb9, user_id=daeb1c2f561243c39f8a8b6aac36e4a7, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:47.250478 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d02b5-7f6f-43a7-864d-5f08e9755d0f admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:47.347100 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1283/2571] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:19:47 2022] PUT /identity/v3/projects/8821e32c806b4c56855d07d720079bb9/users/daeb1c2f561243c39f8a8b6aac36e4a7/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:19:47.358705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021983dd-325d-45ae-8eea-f2fe193a3203 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:47.358987 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021983dd-325d-45ae-8eea-f2fe193a3203 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:47.359259 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021983dd-325d-45ae-8eea-f2fe193a3203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:47.386892 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-021983dd-325d-45ae-8eea-f2fe193a3203 None None] MFA Rules not processed for user `daeb1c2f561243c39f8a8b6aac36e4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:47.388090 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-021983dd-325d-45ae-8eea-f2fe193a3203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:47.454262 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1289/2572] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:19:47.465098 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d02b5-7f6f-43a7-864d-5f08e9755d0f admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:47.467669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-033d02b5-7f6f-43a7-864d-5f08e9755d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:47.524871 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d02b5-7f6f-43a7-864d-5f08e9755d0f admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:47.528496 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6e72d-668c-48be-9182-7a35feb2f8c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1277082583d64fc5a37d50f38393a51c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:47.529755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6e72d-668c-48be-9182-7a35feb2f8c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:47.530033 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6e72d-668c-48be-9182-7a35feb2f8c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:47.530304 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6e72d-668c-48be-9182-7a35feb2f8c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:47.538543 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6e72d-668c-48be-9182-7a35feb2f8c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:47.539964 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6e72d-668c-48be-9182-7a35feb2f8c9 service cinder] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:47.548893 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1284/2573] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:49.269700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741f916-4d8c-4fb6-8cac-18feff28abee None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:49.270227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741f916-4d8c-4fb6-8cac-18feff28abee None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:49.270227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741f916-4d8c-4fb6-8cac-18feff28abee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:49.289461 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5741f916-4d8c-4fb6-8cac-18feff28abee None None] MFA Rules not processed for user `daeb1c2f561243c39f8a8b6aac36e4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:19:49.290653 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5741f916-4d8c-4fb6-8cac-18feff28abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:49.297683 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1290/2574] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:19:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:19:49.344163 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6e72d-668c-48be-9182-7a35feb2f8c9 service cinder] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:49.345940 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-90f6e72d-668c-48be-9182-7a35feb2f8c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:49.352538 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:49.403358 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6e72d-668c-48be-9182-7a35feb2f8c9 service cinder] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:49.407320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be26b7-01c0-485d-b9b9-2164ac0ef0fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74317ae6b47843de85d03f3a9d3a811d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:49.407921 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be26b7-01c0-485d-b9b9-2164ac0ef0fe service glance] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:49.408223 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be26b7-01c0-485d-b9b9-2164ac0ef0fe service glance] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:49.408460 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be26b7-01c0-485d-b9b9-2164ac0ef0fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:49.410215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f5be26b7-01c0-485d-b9b9-2164ac0ef0fe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:49.481666 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be26b7-01c0-485d-b9b9-2164ac0ef0fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:49.483530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be26b7-01c0-485d-b9b9-2164ac0ef0fe service glance] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:49.494546 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1285/2575] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:50.251562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741f916-4d8c-4fb6-8cac-18feff28abee None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:50.253083 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5741f916-4d8c-4fb6-8cac-18feff28abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:50.314331 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741f916-4d8c-4fb6-8cac-18feff28abee None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:50.318078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f60f33-a930-425e-bbd7-937667fb2635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:50.318676 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f60f33-a930-425e-bbd7-937667fb2635 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:50.322654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f60f33-a930-425e-bbd7-937667fb2635 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:50.322654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f60f33-a930-425e-bbd7-937667fb2635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:50.322654 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-73f60f33-a930-425e-bbd7-937667fb2635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:50.335983 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f60f33-a930-425e-bbd7-937667fb2635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:50.337438 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f60f33-a930-425e-bbd7-937667fb2635 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:50.349845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1291/2576] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:54.019375 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be26b7-01c0-485d-b9b9-2164ac0ef0fe service glance] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:54.020866 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-f5be26b7-01c0-485d-b9b9-2164ac0ef0fe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:54.033706 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be26b7-01c0-485d-b9b9-2164ac0ef0fe service glance] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:54.037425 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d185d8-5833-4ac9-80c1-93d6c7646d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:54.038054 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d185d8-5833-4ac9-80c1-93d6c7646d5b service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:54.038401 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d185d8-5833-4ac9-80c1-93d6c7646d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:54.038636 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d185d8-5833-4ac9-80c1-93d6c7646d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:54.040507 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-17d185d8-5833-4ac9-80c1-93d6c7646d5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:54.052229 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d185d8-5833-4ac9-80c1-93d6c7646d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:54.053738 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d185d8-5833-4ac9-80c1-93d6c7646d5b service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:54.062777 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1286/2577] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:19:54.887297 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f60f33-a930-425e-bbd7-937667fb2635 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:19:54.889050 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-73f60f33-a930-425e-bbd7-937667fb2635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:54.902480 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f60f33-a930-425e-bbd7-937667fb2635 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:19:54.908237 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8fd10-d520-4482-bc4f-90ad210f190d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:19:54.908833 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8fd10-d520-4482-bc4f-90ad210f190d service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:19:54.909131 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8fd10-d520-4482-bc4f-90ad210f190d service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:19:54.909434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8fd10-d520-4482-bc4f-90ad210f190d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:19:54.911253 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5aa8fd10-d520-4482-bc4f-90ad210f190d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:19:54.924420 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8fd10-d520-4482-bc4f-90ad210f190d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:19:54.926104 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8fd10-d520-4482-bc4f-90ad210f190d service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:19:54.938264 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1292/2578] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:19:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:20:04.058527 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=58 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:04.933526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:07.267614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d8d25-7119-4818-af00-8bce8f1bd460 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:07.268129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d8d25-7119-4818-af00-8bce8f1bd460 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:07.268242 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d8d25-7119-4818-af00-8bce8f1bd460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:07.317658 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-9d2d8d25-7119-4818-af00-8bce8f1bd460 None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:20:07.318860 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-9d2d8d25-7119-4818-af00-8bce8f1bd460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:07.385627 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1287/2579] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:20:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:20:07.603228 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8fd10-d520-4482-bc4f-90ad210f190d service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:07.604733 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5aa8fd10-d520-4482-bc4f-90ad210f190d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:07.696257 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8fd10-d520-4482-bc4f-90ad210f190d service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:07.701176 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd591fbc-2960-40a1-b5da-c2bd320630df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:07.702063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591fbc-2960-40a1-b5da-c2bd320630df service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:07.702499 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591fbc-2960-40a1-b5da-c2bd320630df service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:07.702897 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd591fbc-2960-40a1-b5da-c2bd320630df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:07.711346 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd591fbc-2960-40a1-b5da-c2bd320630df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:07.712899 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd591fbc-2960-40a1-b5da-c2bd320630df service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:07.721231 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1293/2580] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:20:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:08.509532 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf0884-23b8-4fe1-9aad-1803fd4074c1 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:08.510019 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf0884-23b8-4fe1-9aad-1803fd4074c1 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:08.510136 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf0884-23b8-4fe1-9aad-1803fd4074c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:08.529565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d4cf0884-23b8-4fe1-9aad-1803fd4074c1 None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:20:08.531565 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d4cf0884-23b8-4fe1-9aad-1803fd4074c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:08.538616 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1288/2581] 10.222.0.45 () {58 vars in 967 bytes} [Mon Oct 31 15:20:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:20:08.551226 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd591fbc-2960-40a1-b5da-c2bd320630df service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:08.562349 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd591fbc-2960-40a1-b5da-c2bd320630df service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:08.567635 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ace7f9-6825-4848-b25a-f5918db349aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:08.568227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ace7f9-6825-4848-b25a-f5918db349aa service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:08.568521 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ace7f9-6825-4848-b25a-f5918db349aa service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:08.568789 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ace7f9-6825-4848-b25a-f5918db349aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:08.577179 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ace7f9-6825-4848-b25a-f5918db349aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:08.578750 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ace7f9-6825-4848-b25a-f5918db349aa service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:08.586562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1294/2582] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:20:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:09.196793 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5821627-1ba2-4271-b07e-fc081fbe636a None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:09.197076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5821627-1ba2-4271-b07e-fc081fbe636a None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:09.197399 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5821627-1ba2-4271-b07e-fc081fbe636a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:09.216420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-d5821627-1ba2-4271-b07e-fc081fbe636a None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:20:09.217695 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-d5821627-1ba2-4271-b07e-fc081fbe636a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:09.225062 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1289/2583] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Oct 31 15:20:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:20:09.237321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ace7f9-6825-4848-b25a-f5918db349aa service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:09.247698 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ace7f9-6825-4848-b25a-f5918db349aa service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:09.253626 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7063e-aa7e-43e2-b31f-8bbe2fefcdf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:09.254216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7063e-aa7e-43e2-b31f-8bbe2fefcdf5 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:09.254495 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7063e-aa7e-43e2-b31f-8bbe2fefcdf5 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:09.254764 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7063e-aa7e-43e2-b31f-8bbe2fefcdf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:09.262821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7063e-aa7e-43e2-b31f-8bbe2fefcdf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:09.264530 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7063e-aa7e-43e2-b31f-8bbe2fefcdf5 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:09.272492 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1295/2584] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:20:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:09.918508 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d7328-9e36-4c2f-8160-4bc55df9efa4 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:09.918979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d7328-9e36-4c2f-8160-4bc55df9efa4 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:09.919084 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d7328-9e36-4c2f-8160-4bc55df9efa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:09.938040 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-ae2d7328-9e36-4c2f-8160-4bc55df9efa4 None None] MFA Rules not processed for user `439bd5d7fd094326aa92bcc5057fcc89`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:20:09.939213 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-ae2d7328-9e36-4c2f-8160-4bc55df9efa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:09.946271 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1290/2585] 10.222.0.45 () {58 vars in 967 bytes} [Mon Oct 31 15:20:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:20:09.958821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7063e-aa7e-43e2-b31f-8bbe2fefcdf5 service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:09.970050 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7063e-aa7e-43e2-b31f-8bbe2fefcdf5 service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:09.975453 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f989b-24b5-422d-8df9-f27501d31a7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93cb8e24b84d4c26bf5fd58d93ebb6c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:09.976159 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f989b-24b5-422d-8df9-f27501d31a7c service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:09.976516 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f989b-24b5-422d-8df9-f27501d31a7c service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:09.976786 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f989b-24b5-422d-8df9-f27501d31a7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:09.985376 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f989b-24b5-422d-8df9-f27501d31a7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:09.986943 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f989b-24b5-422d-8df9-f27501d31a7c service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:09.994918 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1296/2586] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Oct 31 15:20:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:12.597986 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d7328-9e36-4c2f-8160-4bc55df9efa4 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:12.659960 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d7328-9e36-4c2f-8160-4bc55df9efa4 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:12.664379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:12.664990 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:12.665270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:12.665558 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] PATH_INFO: `/v3/users/daeb1c2f561243c39f8a8b6aac36e4a7` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:12.666663 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] RBAC: Authorizing `identity:delete_user(user_id=daeb1c2f561243c39f8a8b6aac36e4a7)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:12.668544 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:12.864215 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daeb1c2f561243c39f8a8b6aac36e4a7'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:20:12.864821 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daeb1c2f561243c39f8a8b6aac36e4a7'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:20:12.870009 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:12.877614 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daeb1c2f561243c39f8a8b6aac36e4a7'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:20:12.878270 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daeb1c2f561243c39f8a8b6aac36e4a7'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:20:12.965095 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daeb1c2f561243c39f8a8b6aac36e4a7'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:20:12.977706 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1291/2587] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:20:12 2022] DELETE /identity/v3/users/daeb1c2f561243c39f8a8b6aac36e4a7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:20:12.982544 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20528dbf-0937-4906-9ca4-cf25b285f44c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:12.982941 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20528dbf-0937-4906-9ca4-cf25b285f44c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:12.983076 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20528dbf-0937-4906-9ca4-cf25b285f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:13.003596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-20528dbf-0937-4906-9ca4-cf25b285f44c None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:20:13.004795 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-20528dbf-0937-4906-9ca4-cf25b285f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:13.061235 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1297/2588] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:20:13.071722 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:13.073177 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:13.130847 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c22c58-0264-4def-a104-602636f2515b admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:13.134362 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8a5bf-4590-41b8-8530-86beabbb4aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:13.134958 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8a5bf-4590-41b8-8530-86beabbb4aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:13.135233 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8a5bf-4590-41b8-8530-86beabbb4aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:13.135502 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8a5bf-4590-41b8-8530-86beabbb4aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:13.144530 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8a5bf-4590-41b8-8530-86beabbb4aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:13.145989 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8a5bf-4590-41b8-8530-86beabbb4aa7 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:13.155173 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1292/2589] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:20:13.413641 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20528dbf-0937-4906-9ca4-cf25b285f44c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:13.415078 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-20528dbf-0937-4906-9ca4-cf25b285f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:13.427491 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20528dbf-0937-4906-9ca4-cf25b285f44c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:13.433624 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c30030-ff0a-499f-9543-a9f622978d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:13.434304 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c30030-ff0a-499f-9543-a9f622978d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:13.434586 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c30030-ff0a-499f-9543-a9f622978d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:13.434861 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c30030-ff0a-499f-9543-a9f622978d82 admin admin] PATH_INFO: `/v3/projects/8821e32c806b4c56855d07d720079bb9` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:13.436071 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c30030-ff0a-499f-9543-a9f622978d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8821e32c806b4c56855d07d720079bb9)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:13.438245 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c30030-ff0a-499f-9543-a9f622978d82 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:13.524534 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:13.541178 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-34c30030-ff0a-499f-9543-a9f622978d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8821e32c806b4c56855d07d720079bb9', 'request_id': 'req-34c30030-ff0a-499f-9543-a9f622978d82'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:20:13.614533 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-34c30030-ff0a-499f-9543-a9f622978d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8821e32c806b4c56855d07d720079bb9', 'request_id': 'req-34c30030-ff0a-499f-9543-a9f622978d82'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:20:13.620954 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-34c30030-ff0a-499f-9543-a9f622978d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8821e32c806b4c56855d07d720079bb9', 'request_id': 'req-34c30030-ff0a-499f-9543-a9f622978d82'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:20:13.632154 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-34c30030-ff0a-499f-9543-a9f622978d82 admin admin] The token cache is being invalidate because project 8821e32c806b4c56855d07d720079bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:20:13.632442 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-34c30030-ff0a-499f-9543-a9f622978d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:20:13.633085 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-34c30030-ff0a-499f-9543-a9f622978d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:20:13.634606 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1298/2590] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:13 2022] DELETE /identity/v3/projects/8821e32c806b4c56855d07d720079bb9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:20:13.640343 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7812b-e31c-43a2-b23a-a0241e9c33a0 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:13.640957 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7812b-e31c-43a2-b23a-a0241e9c33a0 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:13.641076 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7812b-e31c-43a2-b23a-a0241e9c33a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:13.661322 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-a4c7812b-e31c-43a2-b23a-a0241e9c33a0 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:20:13.662453 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-a4c7812b-e31c-43a2-b23a-a0241e9c33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:13.723074 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1293/2591] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:20:13.730887 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce4acb-b35c-4ce1-9720-ec7a0171c10b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:13.731171 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce4acb-b35c-4ce1-9720-ec7a0171c10b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:13.731445 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce4acb-b35c-4ce1-9720-ec7a0171c10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:13.750866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6dce4acb-b35c-4ce1-9720-ec7a0171c10b None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:20:13.752059 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6dce4acb-b35c-4ce1-9720-ec7a0171c10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:13.759949 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1299/2592] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:20:13.764059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7812b-e31c-43a2-b23a-a0241e9c33a0 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:13.774572 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7812b-e31c-43a2-b23a-a0241e9c33a0 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:13.779137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca410b-2f3c-4c55-b0f0-be33237922d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:13.779725 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca410b-2f3c-4c55-b0f0-be33237922d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:13.780006 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca410b-2f3c-4c55-b0f0-be33237922d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:13.780279 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca410b-2f3c-4c55-b0f0-be33237922d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:13.781669 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca410b-2f3c-4c55-b0f0-be33237922d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81684) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 31 15:20:13.781974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca410b-2f3c-4c55-b0f0-be33237922d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:13.783561 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca410b-2f3c-4c55-b0f0-be33237922d7 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:13.795500 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1294/2593] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Oct 31 15:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 31 15:20:13.799931 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce4acb-b35c-4ce1-9720-ec7a0171c10b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:13.809682 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce4acb-b35c-4ce1-9720-ec7a0171c10b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:13.815052 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9326e-6843-49e3-ad43-e5e7a4171c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:13.815639 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9326e-6843-49e3-ad43-e5e7a4171c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:13.815916 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9326e-6843-49e3-ad43-e5e7a4171c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:13.816232 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9326e-6843-49e3-ad43-e5e7a4171c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:13.816885 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9326e-6843-49e3-ad43-e5e7a4171c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:13.818792 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9326e-6843-49e3-ad43-e5e7a4171c52 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:13.896697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1300/2594] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:20:13 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:20:13.900528 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca410b-2f3c-4c55-b0f0-be33237922d7 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:13.910499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca410b-2f3c-4c55-b0f0-be33237922d7 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:13.967588 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf2f39-b10c-45d7-a9f5-bc4dec35d050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:13.968112 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf2f39-b10c-45d7-a9f5-bc4dec35d050 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:13.969151 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf2f39-b10c-45d7-a9f5-bc4dec35d050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:13.969462 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf2f39-b10c-45d7-a9f5-bc4dec35d050 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:13.970102 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf2f39-b10c-45d7-a9f5-bc4dec35d050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:13.972008 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf2f39-b10c-45d7-a9f5-bc4dec35d050 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:13.981518 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:14.114397 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1295/2595] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:20:13 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:20:14.118360 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9326e-6843-49e3-ad43-e5e7a4171c52 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:14.129026 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9326e-6843-49e3-ad43-e5e7a4171c52 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:14.133464 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d622cd5-a32c-4989-a63d-ca0c0eb2be01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:14.134048 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d622cd5-a32c-4989-a63d-ca0c0eb2be01 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:14.134320 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d622cd5-a32c-4989-a63d-ca0c0eb2be01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:14.134585 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d622cd5-a32c-4989-a63d-ca0c0eb2be01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:14.135221 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d622cd5-a32c-4989-a63d-ca0c0eb2be01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:14.136807 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d622cd5-a32c-4989-a63d-ca0c0eb2be01 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:14.147444 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1301/2596] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:20:14.151406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf2f39-b10c-45d7-a9f5-bc4dec35d050 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:14.161597 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf2f39-b10c-45d7-a9f5-bc4dec35d050 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:14.166218 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971b1d6-74c3-4cc4-a10c-f257626533b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:14.166845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971b1d6-74c3-4cc4-a10c-f257626533b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:14.167125 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971b1d6-74c3-4cc4-a10c-f257626533b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:14.167395 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971b1d6-74c3-4cc4-a10c-f257626533b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:14.168034 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971b1d6-74c3-4cc4-a10c-f257626533b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:14.169679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971b1d6-74c3-4cc4-a10c-f257626533b7 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:14.180932 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1296/2597] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 31 15:20:14.184891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d622cd5-a32c-4989-a63d-ca0c0eb2be01 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:14.195526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d622cd5-a32c-4989-a63d-ca0c0eb2be01 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:14.200095 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105844cc-804a-488a-93cc-378c014d9eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:14.200722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105844cc-804a-488a-93cc-378c014d9eab admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:14.200996 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105844cc-804a-488a-93cc-378c014d9eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:14.201262 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105844cc-804a-488a-93cc-378c014d9eab admin admin] PATH_INFO: `/v3/projects/0c22d455b78547ddb164be1af039cc0f/users/8e30a028dbca4bac920b7cb2dcd47e02/roles/c3f5b94962604da78f8e1a5d18105768` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:14.215700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105844cc-804a-488a-93cc-378c014d9eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c22d455b78547ddb164be1af039cc0f, user_id=8e30a028dbca4bac920b7cb2dcd47e02, role_id=c3f5b94962604da78f8e1a5d18105768)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:14.218463 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105844cc-804a-488a-93cc-378c014d9eab admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:14.297622 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1302/2598] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:20:14 2022] PUT /identity/v3/projects/0c22d455b78547ddb164be1af039cc0f/users/8e30a028dbca4bac920b7cb2dcd47e02/roles/c3f5b94962604da78f8e1a5d18105768 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:20:14.302770 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be296d6-c2f1-4244-86a4-3ecbf7e0f703 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:14.303054 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be296d6-c2f1-4244-86a4-3ecbf7e0f703 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:14.303324 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be296d6-c2f1-4244-86a4-3ecbf7e0f703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:14.323525 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-3be296d6-c2f1-4244-86a4-3ecbf7e0f703 None None] MFA Rules not processed for user `6869ed0ef88b494189d119f94f621131`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:20:14.324743 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-3be296d6-c2f1-4244-86a4-3ecbf7e0f703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:14.385312 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1297/2599] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:20:14.394950 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105844cc-804a-488a-93cc-378c014d9eab admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:14.396781 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-105844cc-804a-488a-93cc-378c014d9eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:14.452929 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105844cc-804a-488a-93cc-378c014d9eab admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:14.456501 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f69d3e-1d54-40aa-970f-94ad1c6575f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:14.457094 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f69d3e-1d54-40aa-970f-94ad1c6575f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:14.457395 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f69d3e-1d54-40aa-970f-94ad1c6575f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:14.457662 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f69d3e-1d54-40aa-970f-94ad1c6575f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:14.466373 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f69d3e-1d54-40aa-970f-94ad1c6575f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:14.467779 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f69d3e-1d54-40aa-970f-94ad1c6575f9 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:14.476978 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1303/2600] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:20:19.841844 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1cda9-72c0-4619-8a6f-0c0ed8f38edb None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:19.842320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1cda9-72c0-4619-8a6f-0c0ed8f38edb None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:19.842406 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1cda9-72c0-4619-8a6f-0c0ed8f38edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:19.876169 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-7cd1cda9-72c0-4619-8a6f-0c0ed8f38edb None None] MFA Rules not processed for user `8e30a028dbca4bac920b7cb2dcd47e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:20:19.877415 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-7cd1cda9-72c0-4619-8a6f-0c0ed8f38edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:19.949253 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1298/2601] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:20:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:20:19.954431 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f69d3e-1d54-40aa-970f-94ad1c6575f9 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:19.964578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f69d3e-1d54-40aa-970f-94ad1c6575f9 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:19.969552 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ccada-df14-461e-b1c0-38689c6ab4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:19.970284 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ccada-df14-461e-b1c0-38689c6ab4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:19.970655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ccada-df14-461e-b1c0-38689c6ab4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:19.971184 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ccada-df14-461e-b1c0-38689c6ab4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:19.971913 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ccada-df14-461e-b1c0-38689c6ab4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:19.974539 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ccada-df14-461e-b1c0-38689c6ab4c2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:20.142845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1304/2602] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Oct 31 15:20:19 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 31 15:20:20.146872 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1cda9-72c0-4619-8a6f-0c0ed8f38edb None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:20.158283 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1cda9-72c0-4619-8a6f-0c0ed8f38edb None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:20.218581 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ef4d2-9c8c-4209-90e9-6e5834a07324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:20.219194 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ef4d2-9c8c-4209-90e9-6e5834a07324 admin admin] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:20.219473 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ef4d2-9c8c-4209-90e9-6e5834a07324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:20.219745 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ef4d2-9c8c-4209-90e9-6e5834a07324 admin admin] PATH_INFO: `/v3/users` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:20.220391 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ef4d2-9c8c-4209-90e9-6e5834a07324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:20.222393 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ef4d2-9c8c-4209-90e9-6e5834a07324 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:20.324758 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:20.329949 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1299/2603] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Oct 31 15:20:20 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 31 15:20:20.334182 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ccada-df14-461e-b1c0-38689c6ab4c2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:20.345830 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ccada-df14-461e-b1c0-38689c6ab4c2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:20.351164 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fc5ba-3f59-421c-b77e-80216b302eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:20.356142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fc5ba-3f59-421c-b77e-80216b302eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:20.356142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fc5ba-3f59-421c-b77e-80216b302eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:20.356142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fc5ba-3f59-421c-b77e-80216b302eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:20.356142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65fc5ba-3f59-421c-b77e-80216b302eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:20.356142 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65fc5ba-3f59-421c-b77e-80216b302eb9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:20.366572 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1305/2604] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:20:20.370696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ef4d2-9c8c-4209-90e9-6e5834a07324 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:20.382154 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ef4d2-9c8c-4209-90e9-6e5834a07324 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:20.387674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d197a-2b35-4c9e-843b-64d8ed0e5273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:20.388341 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d197a-2b35-4c9e-843b-64d8ed0e5273 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:20.388618 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d197a-2b35-4c9e-843b-64d8ed0e5273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:20.388886 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d197a-2b35-4c9e-843b-64d8ed0e5273 admin admin] PATH_INFO: `/v3/projects/779e280632574518bfcd7bd79561b868/users/7cde24da54544c849804dca47a763cdc/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:20.404628 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d197a-2b35-4c9e-843b-64d8ed0e5273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779e280632574518bfcd7bd79561b868, user_id=7cde24da54544c849804dca47a763cdc, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:20.407494 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d197a-2b35-4c9e-843b-64d8ed0e5273 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:20.496950 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1300/2605] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:20:20 2022] PUT /identity/v3/projects/779e280632574518bfcd7bd79561b868/users/7cde24da54544c849804dca47a763cdc/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:20:20.501676 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fc5ba-3f59-421c-b77e-80216b302eb9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:20.511877 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fc5ba-3f59-421c-b77e-80216b302eb9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:20.529732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:20.573024 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626748b-58b1-4630-a0ac-ecc88ee9f520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:20.573711 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626748b-58b1-4630-a0ac-ecc88ee9f520 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:20.573988 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626748b-58b1-4630-a0ac-ecc88ee9f520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:20.574252 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626748b-58b1-4630-a0ac-ecc88ee9f520 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:20.574895 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626748b-58b1-4630-a0ac-ecc88ee9f520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:20.576700 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626748b-58b1-4630-a0ac-ecc88ee9f520 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:20.587434 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1306/2606] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Oct 31 15:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 31 15:20:20.591556 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d197a-2b35-4c9e-843b-64d8ed0e5273 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:20.603169 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d197a-2b35-4c9e-843b-64d8ed0e5273 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:20.610045 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252109f-fa31-4a46-806c-0a02a5ba6f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:20.615674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252109f-fa31-4a46-806c-0a02a5ba6f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:20.615674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252109f-fa31-4a46-806c-0a02a5ba6f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:20.615674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252109f-fa31-4a46-806c-0a02a5ba6f00 admin admin] PATH_INFO: `/v3/projects/779e280632574518bfcd7bd79561b868/users/7cde24da54544c849804dca47a763cdc/roles/c62ffefc63e74a1280bef2b6a22202ad` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:20.615674 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252109f-fa31-4a46-806c-0a02a5ba6f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779e280632574518bfcd7bd79561b868, user_id=7cde24da54544c849804dca47a763cdc, role_id=c62ffefc63e74a1280bef2b6a22202ad)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:20.617421 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252109f-fa31-4a46-806c-0a02a5ba6f00 admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:20.631368 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1301/2607] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Oct 31 15:20:20 2022] PUT /identity/v3/projects/779e280632574518bfcd7bd79561b868/users/7cde24da54544c849804dca47a763cdc/roles/c62ffefc63e74a1280bef2b6a22202ad => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 31 15:20:26.222057 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69915df8-dc6c-462d-aad4-3d50a125a059 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:26.222632 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69915df8-dc6c-462d-aad4-3d50a125a059 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:26.223535 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69915df8-dc6c-462d-aad4-3d50a125a059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:26.258578 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-69915df8-dc6c-462d-aad4-3d50a125a059 None None] MFA Rules not processed for user `7cde24da54544c849804dca47a763cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:20:26.259811 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-69915df8-dc6c-462d-aad4-3d50a125a059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:26.340102 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1307/2608] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:20:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:20:26.357679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252109f-fa31-4a46-806c-0a02a5ba6f00 admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:26.369257 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-8252109f-fa31-4a46-806c-0a02a5ba6f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:26.459059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252109f-fa31-4a46-806c-0a02a5ba6f00 admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:26.464680 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98d33e-9c45-4514-bed4-392b5186edc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:26.465320 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98d33e-9c45-4514-bed4-392b5186edc9 service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:26.465598 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98d33e-9c45-4514-bed4-392b5186edc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:26.465864 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98d33e-9c45-4514-bed4-392b5186edc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:26.538579 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98d33e-9c45-4514-bed4-392b5186edc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:26.540283 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98d33e-9c45-4514-bed4-392b5186edc9 service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:26.550684 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1302/2609] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:20:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:20:29.190300 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cf643-0c91-4580-bcb8-6fae175f6fe8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:29.190805 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cf643-0c91-4580-bcb8-6fae175f6fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:29.190916 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cf643-0c91-4580-bcb8-6fae175f6fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:29.212387 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-460cf643-0c91-4580-bcb8-6fae175f6fe8 None None] MFA Rules not processed for user `8e30a028dbca4bac920b7cb2dcd47e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:20:29.213715 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-460cf643-0c91-4580-bcb8-6fae175f6fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:29.221642 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1308/2610] 10.222.0.45 () {58 vars in 958 bytes} [Mon Oct 31 15:20:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 31 15:20:36.545759 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=71,keystone:INSERT=2 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:39.205222 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=57 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:46.266281 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98d33e-9c45-4514-bed4-392b5186edc9 service nova] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:46.321762 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98d33e-9c45-4514-bed4-392b5186edc9 service nova] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:46.325340 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f93ef-f588-44f6-bc54-e36f357b217b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:46.325971 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f93ef-f588-44f6-bc54-e36f357b217b service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:46.326245 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f93ef-f588-44f6-bc54-e36f357b217b service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:46.326512 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f93ef-f588-44f6-bc54-e36f357b217b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:46.328285 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b30f93ef-f588-44f6-bc54-e36f357b217b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:46.338422 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f93ef-f588-44f6-bc54-e36f357b217b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:46.339832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f93ef-f588-44f6-bc54-e36f357b217b service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:46.347905 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1303/2611] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:20:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:20:47.269896 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cf643-0c91-4580-bcb8-6fae175f6fe8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:47.272761 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-460cf643-0c91-4580-bcb8-6fae175f6fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:47.345615 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cf643-0c91-4580-bcb8-6fae175f6fe8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:47.350528 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6b4d7-0bb4-41fa-a0ac-3556868042a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:47.351359 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6b4d7-0bb4-41fa-a0ac-3556868042a8 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:47.351564 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6b4d7-0bb4-41fa-a0ac-3556868042a8 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:47.351804 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6b4d7-0bb4-41fa-a0ac-3556868042a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:47.353610 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b7c6b4d7-0bb4-41fa-a0ac-3556868042a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:47.365118 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6b4d7-0bb4-41fa-a0ac-3556868042a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:47.367459 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6b4d7-0bb4-41fa-a0ac-3556868042a8 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:47.377233 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1309/2612] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:20:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:20:56.344171 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=26 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:57.372969 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=32 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:58.756333 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f93ef-f588-44f6-bc54-e36f357b217b service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:20:58.757924 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-b30f93ef-f588-44f6-bc54-e36f357b217b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:58.774448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f93ef-f588-44f6-bc54-e36f357b217b service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:20:58.780879 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e30a3-a78e-4ce2-b4d6-6cd2609bf39f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:20:58.783629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e30a3-a78e-4ce2-b4d6-6cd2609bf39f service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:20:58.783629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e30a3-a78e-4ce2-b4d6-6cd2609bf39f service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:20:58.783629 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e30a3-a78e-4ce2-b4d6-6cd2609bf39f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:20:58.783884 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-222e30a3-a78e-4ce2-b4d6-6cd2609bf39f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:20:58.796458 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e30a3-a78e-4ce2-b4d6-6cd2609bf39f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:20:58.798166 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e30a3-a78e-4ce2-b4d6-6cd2609bf39f service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:20:58.811088 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1304/2613] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:20:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:21:01.458844 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6b4d7-0bb4-41fa-a0ac-3556868042a8 service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:21:01.460266 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b7c6b4d7-0bb4-41fa-a0ac-3556868042a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:21:01.472429 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6b4d7-0bb4-41fa-a0ac-3556868042a8 service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:21:01.476063 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c1132-d6d7-4b40-afea-aec8f2173fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:21:01.476651 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c1132-d6d7-4b40-afea-aec8f2173fdc service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:21:01.476935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c1132-d6d7-4b40-afea-aec8f2173fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:21:01.477207 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c1132-d6d7-4b40-afea-aec8f2173fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:21:01.486258 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c1132-d6d7-4b40-afea-aec8f2173fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:21:01.487665 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c1132-d6d7-4b40-afea-aec8f2173fdc service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:21:01.497451 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1310/2614] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:21:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:21:08.805672 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=6 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:11.492744 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:18.034048 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e30a3-a78e-4ce2-b4d6-6cd2609bf39f service nova] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:22:18.035479 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-222e30a3-a78e-4ce2-b4d6-6cd2609bf39f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:22:18.049236 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e30a3-a78e-4ce2-b4d6-6cd2609bf39f service nova] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:22:18.054410 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d84ec-672c-4346-93d9-46c7122b0ced service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:22:18.055000 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d84ec-672c-4346-93d9-46c7122b0ced service placement] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:22:18.055273 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d84ec-672c-4346-93d9-46c7122b0ced service placement] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:22:18.055537 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d84ec-672c-4346-93d9-46c7122b0ced service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:22:18.057605 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-df8d84ec-672c-4346-93d9-46c7122b0ced service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:22:18.069230 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d84ec-672c-4346-93d9-46c7122b0ced service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:22:18.070819 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d84ec-672c-4346-93d9-46c7122b0ced service placement] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:22:18.081724 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1305/2615] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:22:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:22:28.077165 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=6 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:41.446418 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0b659-00e0-408b-a45c-22364f95d054 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:23:41.447169 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0b659-00e0-408b-a45c-22364f95d054 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:23:41.447169 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0b659-00e0-408b-a45c-22364f95d054 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:23:41.448358 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1311/2616] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 31 15:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:23:41.454787 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af5dbc-f26b-448c-8b17-e5f637b0bbb3 None None] REQUEST_METHOD: `POST` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:23:41.455286 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af5dbc-f26b-448c-8b17-e5f637b0bbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:23:41.455404 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af5dbc-f26b-448c-8b17-e5f637b0bbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:23:41.494399 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.auth.core [None req-95af5dbc-f26b-448c-8b17-e5f637b0bbb3 None None] MFA Rules not processed for user `93815827ae97419abf6fa45fbab185f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81684) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:23:41.495599 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-95af5dbc-f26b-448c-8b17-e5f637b0bbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:23:41.502082 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1306/2617] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 31 15:23:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:23:41.514655 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0b659-00e0-408b-a45c-22364f95d054 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:23:41.526232 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0b659-00e0-408b-a45c-22364f95d054 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:23:41.529736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37067009-3842-4ae8-8c66-5f973c5e4752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:23:41.530321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37067009-3842-4ae8-8c66-5f973c5e4752 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:23:41.530596 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37067009-3842-4ae8-8c66-5f973c5e4752 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:23:41.530866 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37067009-3842-4ae8-8c66-5f973c5e4752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:23:41.537946 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37067009-3842-4ae8-8c66-5f973c5e4752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:23:41.539380 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37067009-3842-4ae8-8c66-5f973c5e4752 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:23:41.547306 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1312/2618] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:23:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 31 15:23:41.629104 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ca7f-73be-4e27-9e04-1835488239b5 None None] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:23:41.629430 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ca7f-73be-4e27-9e04-1835488239b5 None None] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:23:41.629707 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ca7f-73be-4e27-9e04-1835488239b5 None None] PATH_INFO: `/` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:23:41.631086 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1307/2619] 10.222.0.45 () {54 vars in 921 bytes} [Mon Oct 31 15:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 31 15:23:41.637562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ceb74-0978-49ad-a727-047450bd8236 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:23:41.637845 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ceb74-0978-49ad-a727-047450bd8236 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:23:41.638115 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ceb74-0978-49ad-a727-047450bd8236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:23:41.675541 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ab2ceb74-0978-49ad-a727-047450bd8236 None None] MFA Rules not processed for user `9ec30e419d6f4fddb05c4bb08f2ce3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 31 15:23:41.676732 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ab2ceb74-0978-49ad-a727-047450bd8236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:23:41.686736 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1313/2620] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Oct 31 15:23:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 31 15:23:41.697643 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26ca7f-73be-4e27-9e04-1835488239b5 None None] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:23:41.708428 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26ca7f-73be-4e27-9e04-1835488239b5 None None] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:23:41.712161 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfded9a-5b9f-4393-8a64-5c346d540109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:23:41.712739 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfded9a-5b9f-4393-8a64-5c346d540109 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:23:41.713017 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfded9a-5b9f-4393-8a64-5c346d540109 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:23:41.713311 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfded9a-5b9f-4393-8a64-5c346d540109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:23:41.723007 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfded9a-5b9f-4393-8a64-5c346d540109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:23:41.724412 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfded9a-5b9f-4393-8a64-5c346d540109 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:23:41.735087 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1308/2621] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:23:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:23:51.673239 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=15 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:51.730888 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=15 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:23.751891 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ceb74-0978-49ad-a727-047450bd8236 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:23.762074 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ceb74-0978-49ad-a727-047450bd8236 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:23.765562 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7124e0-b1e9-420a-99ad-253b99f5d9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:23.766149 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7124e0-b1e9-420a-99ad-253b99f5d9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:23.766422 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7124e0-b1e9-420a-99ad-253b99f5d9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:23.766688 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7124e0-b1e9-420a-99ad-253b99f5d9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:23.768386 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3b7124e0-b1e9-420a-99ad-253b99f5d9e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:23.778348 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7124e0-b1e9-420a-99ad-253b99f5d9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:23.779754 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7124e0-b1e9-420a-99ad-253b99f5d9e1 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:23.787636 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1314/2622] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:33.783977 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:36.585702 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfded9a-5b9f-4393-8a64-5c346d540109 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:36.594832 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfded9a-5b9f-4393-8a64-5c346d540109 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:36.598379 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce68fa6-0be8-411b-b2ec-0eb4fd8a0347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:36.598966 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce68fa6-0be8-411b-b2ec-0eb4fd8a0347 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:36.599239 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce68fa6-0be8-411b-b2ec-0eb4fd8a0347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:36.599504 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce68fa6-0be8-411b-b2ec-0eb4fd8a0347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:36.608248 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce68fa6-0be8-411b-b2ec-0eb4fd8a0347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:36.609696 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce68fa6-0be8-411b-b2ec-0eb4fd8a0347 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:36.618286 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1309/2623] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:37.749256 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7124e0-b1e9-420a-99ad-253b99f5d9e1 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:37.764526 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7124e0-b1e9-420a-99ad-253b99f5d9e1 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:37.770697 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb38c27-f136-4f2b-a29e-e2d3a85644d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:37.771375 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38c27-f136-4f2b-a29e-e2d3a85644d7 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:37.771852 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38c27-f136-4f2b-a29e-e2d3a85644d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:37.772193 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb38c27-f136-4f2b-a29e-e2d3a85644d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:37.774125 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3bb38c27-f136-4f2b-a29e-e2d3a85644d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:37.792302 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb38c27-f136-4f2b-a29e-e2d3a85644d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:37.792302 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb38c27-f136-4f2b-a29e-e2d3a85644d7 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:37.803886 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1315/2624] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:38.165003 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce68fa6-0be8-411b-b2ec-0eb4fd8a0347 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:38.174319 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce68fa6-0be8-411b-b2ec-0eb4fd8a0347 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:38.178073 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53baabe2-66a9-4c31-8865-861f467c64c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:38.178676 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baabe2-66a9-4c31-8865-861f467c64c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:38.178948 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baabe2-66a9-4c31-8865-861f467c64c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:38.179217 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baabe2-66a9-4c31-8865-861f467c64c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:38.181032 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-53baabe2-66a9-4c31-8865-861f467c64c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:38.196779 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53baabe2-66a9-4c31-8865-861f467c64c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:38.198254 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53baabe2-66a9-4c31-8865-861f467c64c0 service neutron] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:38.210420 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1310/2625] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:39.400698 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb38c27-f136-4f2b-a29e-e2d3a85644d7 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:39.411084 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb38c27-f136-4f2b-a29e-e2d3a85644d7 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:39.414799 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dc8e1-5442-46e3-8977-0be4d289389b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:39.415388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dc8e1-5442-46e3-8977-0be4d289389b service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:39.415664 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dc8e1-5442-46e3-8977-0be4d289389b service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:39.415935 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dc8e1-5442-46e3-8977-0be4d289389b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:39.417912 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-381dc8e1-5442-46e3-8977-0be4d289389b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:39.430987 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dc8e1-5442-46e3-8977-0be4d289389b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:39.432388 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dc8e1-5442-46e3-8977-0be4d289389b service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:39.444322 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1316/2626] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:40.092677 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53baabe2-66a9-4c31-8865-861f467c64c0 service neutron] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:40.103942 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53baabe2-66a9-4c31-8865-861f467c64c0 service neutron] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:40.110159 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02160449-227c-4c18-aa0b-f6ba9329f55c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec30e419d6f4fddb05c4bb08f2ce3f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:40.114532 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160449-227c-4c18-aa0b-f6ba9329f55c service nova] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:40.114532 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160449-227c-4c18-aa0b-f6ba9329f55c service nova] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:40.114532 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160449-227c-4c18-aa0b-f6ba9329f55c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:40.114532 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-02160449-227c-4c18-aa0b-f6ba9329f55c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:40.125535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02160449-227c-4c18-aa0b-f6ba9329f55c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:40.127137 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02160449-227c-4c18-aa0b-f6ba9329f55c service nova] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:40.137583 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1311/2627] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:42.080856 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dc8e1-5442-46e3-8977-0be4d289389b service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:42.090321 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dc8e1-5442-46e3-8977-0be4d289389b service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:42.094032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdb53b-1531-4b7e-b8e6-c9d4695f2fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93815827ae97419abf6fa45fbab185f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:42.094763 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdb53b-1531-4b7e-b8e6-c9d4695f2fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:42.095042 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdb53b-1531-4b7e-b8e6-c9d4695f2fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:42.095308 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdb53b-1531-4b7e-b8e6-c9d4695f2fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:42.155274 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdb53b-1531-4b7e-b8e6-c9d4695f2fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:42.156727 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdb53b-1531-4b7e-b8e6-c9d4695f2fd7 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:42.166154 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1317/2628] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:45.636485 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02160449-227c-4c18-aa0b-f6ba9329f55c service nova] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:45.648499 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02160449-227c-4c18-aa0b-f6ba9329f55c service nova] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:45.653679 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa2379-a77f-4d9a-87b6-02aa7126d776 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:45.654358 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa2379-a77f-4d9a-87b6-02aa7126d776 service placement] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:45.654631 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa2379-a77f-4d9a-87b6-02aa7126d776 service placement] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:45.654897 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa2379-a77f-4d9a-87b6-02aa7126d776 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:45.656632 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-04fa2379-a77f-4d9a-87b6-02aa7126d776 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:45.668780 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa2379-a77f-4d9a-87b6-02aa7126d776 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:45.670448 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa2379-a77f-4d9a-87b6-02aa7126d776 service placement] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:45.680799 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1312/2629] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:49.322309 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdb53b-1531-4b7e-b8e6-c9d4695f2fd7 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:49.334137 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdb53b-1531-4b7e-b8e6-c9d4695f2fd7 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:49.339720 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cc699-9304-4067-b274-6c7a11e3adc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:49.340415 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc699-9304-4067-b274-6c7a11e3adc6 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:49.340705 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc699-9304-4067-b274-6c7a11e3adc6 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:49.340981 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cc699-9304-4067-b274-6c7a11e3adc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:49.342821 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-412cc699-9304-4067-b274-6c7a11e3adc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:49.354476 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cc699-9304-4067-b274-6c7a11e3adc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:49.356462 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cc699-9304-4067-b274-6c7a11e3adc6 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:49.367436 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1318/2630] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:25:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:49.473603 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa2379-a77f-4d9a-87b6-02aa7126d776 service placement] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:49.485713 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa2379-a77f-4d9a-87b6-02aa7126d776 service placement] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:49.490217 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:49.490855 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:49.491129 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:49.491398 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] PATH_INFO: `/v3/users/8e30a028dbca4bac920b7cb2dcd47e02` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:49.492489 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e30a028dbca4bac920b7cb2dcd47e02)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:49.494484 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:49.750143 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e30a028dbca4bac920b7cb2dcd47e02'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:49.750755 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e30a028dbca4bac920b7cb2dcd47e02'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:49.763352 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e30a028dbca4bac920b7cb2dcd47e02'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:49.763979 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e30a028dbca4bac920b7cb2dcd47e02'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:49.847447 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e30a028dbca4bac920b7cb2dcd47e02'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:49.861078 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1313/2631] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:25:49 2022] DELETE /identity/v3/users/8e30a028dbca4bac920b7cb2dcd47e02 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:25:50.140402 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cc699-9304-4067-b274-6c7a11e3adc6 service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:50.150915 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cc699-9304-4067-b274-6c7a11e3adc6 service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:50.207802 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:50.208417 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:50.208691 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:50.208957 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] PATH_INFO: `/v3/projects/0c22d455b78547ddb164be1af039cc0f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:50.210105 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c22d455b78547ddb164be1af039cc0f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:50.211994 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:50.333577 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c22d455b78547ddb164be1af039cc0f', 'request_id': 'req-0fd4c733-fc59-4308-9be0-a68bdcd87487'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:50.409747 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c22d455b78547ddb164be1af039cc0f', 'request_id': 'req-0fd4c733-fc59-4308-9be0-a68bdcd87487'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:50.410900 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:50.416619 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c22d455b78547ddb164be1af039cc0f', 'request_id': 'req-0fd4c733-fc59-4308-9be0-a68bdcd87487'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:50.427439 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] The token cache is being invalidate because project 0c22d455b78547ddb164be1af039cc0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:25:50.427722 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:50.428352 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:50.429856 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1319/2632] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:25:50 2022] DELETE /identity/v3/projects/0c22d455b78547ddb164be1af039cc0f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:25:50.433974 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:50.435708 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:50.448998 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0de4e-84a1-4587-8aa3-e6be894f7b5e admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:50.507730 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:50.508562 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:50.508845 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:50.509241 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] PATH_INFO: `/v3/users/7cde24da54544c849804dca47a763cdc` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:50.511010 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cde24da54544c849804dca47a763cdc)` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:50.512336 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:50.536810 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:50.721831 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cde24da54544c849804dca47a763cdc'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:50.722400 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cde24da54544c849804dca47a763cdc'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:50.734706 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cde24da54544c849804dca47a763cdc'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:50.735366 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cde24da54544c849804dca47a763cdc'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:50.818605 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.notifications [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cde24da54544c849804dca47a763cdc'} {{(pid=81684) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:50.831898 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1314/2633] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Oct 31 15:25:50 2022] DELETE /identity/v3/users/7cde24da54544c849804dca47a763cdc => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:25:51.120993 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:25:51.122576 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:25:51.135721 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4c733-fc59-4308-9be0-a68bdcd87487 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:25:51.193315 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6869ed0ef88b494189d119f94f621131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4bc3597085f4d879b8fe33c50ed5ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:25:51.193940 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:25:51.194216 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:25:51.194487 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e admin admin] PATH_INFO: `/v3/projects/779e280632574518bfcd7bd79561b868` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:25:51.195602 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=779e280632574518bfcd7bd79561b868)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:25:51.197569 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:25:51.368227 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779e280632574518bfcd7bd79561b868', 'request_id': 'req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:51.453401 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779e280632574518bfcd7bd79561b868', 'request_id': 'req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:51.460171 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779e280632574518bfcd7bd79561b868', 'request_id': 'req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:51.471146 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e admin admin] The token cache is being invalidate because project 779e280632574518bfcd7bd79561b868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 31 15:25:51.471432 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:51.472065 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6b77257d-7f3b-4571-9c6d-d5f4b3724a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 31 15:25:51.473566 dv-cinder-860227-3-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1320/2634] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Oct 31 15:25:51 2022] DELETE /identity/v3/projects/779e280632574518bfcd7bd79561b868 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 31 15:26:00.964120 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:01.468032 dv-cinder-860227-3-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=56,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:22.969059 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] Authenticating user token {{(pid=81684) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 31 15:27:22.970534 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:23.109480 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606e159-a646-4104-a126-7245c6fe6ede admin admin] Validating token access rules against request {{(pid=81684) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 31 15:27:23.167677 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f91750-69b4-415c-bae8-4044c8214eaf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77b43d235d0441b3b8a272d051b54ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b82a0373e3b649f3a023efd8db204123', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81684) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 31 15:27:23.168273 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f91750-69b4-415c-bae8-4044c8214eaf service placement] REQUEST_METHOD: `GET` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 31 15:27:23.168547 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f91750-69b4-415c-bae8-4044c8214eaf service placement] SCRIPT_NAME: `/identity` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 31 15:27:23.168813 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f91750-69b4-415c-bae8-4044c8214eaf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81684) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 31 15:27:23.170535 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.fernet_utils [None req-e0f91750-69b4-415c-bae8-4044c8214eaf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81684) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 31 15:27:23.181687 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f91750-69b4-415c-bae8-4044c8214eaf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 31 15:27:23.183246 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f91750-69b4-415c-bae8-4044c8214eaf service placement] RBAC: Authorization granted {{(pid=81684) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 31 15:27:23.193148 dv-cinder-860227-3-smb devstack@keystone.service[81684]: [pid: 81684|app: 0|req: 1315/2635] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Oct 31 15:27:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 31 15:27:33.188937 dv-cinder-860227-3-smb devstack@keystone.service[81684]: DEBUG dbcounter [-] [81684] Writing DB stats keystone:SELECT=89 {{(pid=81684) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}